Orbiter History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [....................XX.............................X........] duration: 1.958180764s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:45:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.958219063s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.....................XX.............................X.......] duration: 1.953781629s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:45:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.953916615s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [......................XX.............................X......] duration: 2.047579264s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:44:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.047729372s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.......................XX.............................X.....] duration: 1.902227851s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:43:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.902255579s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [........................XX.............................X....] duration: 1.995469358s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:42:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.995519374s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [.........................XX.............................X...] duration: 1.946340759s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:41:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.946366659s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [..........................XX.............................X..] duration: 2.665669141s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:41:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.665817545s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [...........................XX.............................X.] duration: 16.494171185s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:41:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 16.494240918s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [............................XX.............................X] duration: 1m1.540003607s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 05:41:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1m1.540032145s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.............................XX.............................] duration: 1.96536993s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:39:11 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 1.96541262s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..............................XX............................] duration: 4.408754241s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:38:21 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 4.408779416s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...............................XX...........................] duration: 1.945044387s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:37:51 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 1.945148968s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [................................XX..........................] duration: 2.390302882s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:37:29 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 2.390336626s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.................................XX.........................] duration: 2.018445474s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:36:33 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 2.018469067s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..................................XX........................] duration: 2.088199172s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:35:24 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 2.088249413s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...................................XX.......................] duration: 3.562207435s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:34:19 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 3.562237303s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [....................................XX......................] duration: 2.022767426s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:33:10 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 2.022850145s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.....................................XX.....................] duration: 1.976051786s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:32:41 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 1.976184483s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [......................................XX....................] duration: 2.226347305s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:32:05 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 2.226380044s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.......................................XX...................] duration: 2.290270077s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:31:45 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 2.290303711s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [........................................XX..................] duration: 27.995982282s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:31:30 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 27.996019283s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.........................................XX.................] duration: 1.974253713s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:29:59 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 1.974330522s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..........................................XX................] duration: 1.931809299s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:29:27 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 1.93183874s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...........................................XX...............] duration: 45.154439448s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:29:03 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 45.154472378s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [............................................XX..............] duration: 3.770679065s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:27:07 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 3.770705796s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.............................................XX.............] duration: 1.940274351s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:26:48 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 1.940466454s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..............................................XX............] duration: 2.124849954s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:26:00 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 2.124894397s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...............................................XX...........] duration: 4.050914217s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:25:45 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 4.050954166s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [................................................XX..........] duration: 7.158565968s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:25:02 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 7.158593653s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.................................................XX.........] duration: 4.279946048s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:23:50 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 4.279971737s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..................................................XX........] duration: 2.538539776s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:23:09 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 2.538579115s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...................................................XX.......] duration: 2.109211974s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:22:34 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 2.10924077s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [....................................................XX......] duration: 2.025308142s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:21:52 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 2.025353004s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.....................................................XX.....] duration: 2.105801286s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:20:50 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 2.105852781s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [......................................................XX....] duration: 2.092244345s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:20:11 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 2.092278756s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.......................................................XX...] duration: 1.997905008s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:19:39 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 1.997941945s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [........................................................XX..] duration: 47.191460908s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:19:24 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 47.191520695s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.........................................................XX.] duration: 5.614718718s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:18:27 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 5.614742158s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 1m0.003640531s trace: https://jaeger.dev.storj.io/trace/326ac5583b2bb19c FAIL (2026-05-25 05:18:21 UTC) orbiter warning: operation: DeleteObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== C37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369110522 (586h29m6.541228966s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369575957 (586h29m6.541694376s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.369753407 (586h29m6.541871835s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370121142 (586h29m6.542239562s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370198366 (586h29m6.542316791s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370575229 (586h29m6.542693657s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.370654518 (586h29m6.542772947s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371103813 (586h29m6.543222232s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371135357 (586h29m6.543253776s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371533431 (586h29m6.543651849s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.371564041 (586h29m6.543682489s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372030968 (586h29m6.544149398s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372045426 (586h29m6.544163852s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372469448 (586h29m6.544587867s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.372502782 (586h29m6.544621211s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.373082095 (586h29m6.545200523s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Uploading piece... May 25 05:17:54.843400928 (586h29m7.015519368s) [upload=656637]: Next returned nil segment May 25 05:17:54.843424368 (586h29m7.015542796s) [upload=656637]: Waiting for error group managing segments... May 25 05:17:54.968149604 (586h29m7.140268022s) [noise=true , address=212.102.52.215:4377 , piece_id=TGSHXIZWJ3P673N3IV7QPTPMXEW3R7TRWKJBESJFYSXGH3SXMABA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970108821 (586h29m7.142227241s) [noise=true , address=212.102.52.216:4401 , piece_id=Z6MBOO5A6BYIWVCMPSU47UQVB2X7WTBQZHOGDCNSIFYJRBTJTSXQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970378693 (586h29m7.142497122s) [noise=true , address=212.102.52.213:4338 , piece_id=IIJZC2DWHVU3QHFNA2HF22LRCOL5QOPVKFY4FFQFRWZKWIZ4UBYA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.970795910 (586h29m7.142914335s) [noise=true , address=212.102.52.216:4403 , piece_id=A3GOO2RNPKOYUFBOMI3F46OU2WLSWNB33LFNTRAVY2SD2AAZSMSQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971464443 (586h29m7.143582863s) [noise=true , address=212.102.52.214:4367 , piece_id=BDK77EOVOWZIAKXFVQWAP3IXWKAONCJKI3YYOG22UN4FNOAYIZZQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.971606165 (586h29m7.143724586s) [noise=true , address=212.102.52.214:4368 , piece_id=3V2IHPVYCQL6VSIKKYM5FQKVV5OHIS5ZU5NSR75IX5SYW4IP3ICA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.974563650 (586h29m7.146682069s) [noise=true , address=212.102.52.216:4398 , piece_id=JCKRBHUFGCIH7543PBJPYFKEKW5ITDHRQFLSSQOPVPKNO5MXWR3A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.978564509 (586h29m7.150682931s) [noise=true , address=212.102.52.213:4344 , piece_id=OXVCWTCTKZPHUHLR55HTX7UGAC4UNLC6PDKXY6IZOYEWRDKVNGNQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.979859817 (586h29m7.151978237s) [noise=true , address=212.102.52.214:4358 , piece_id=W3CTI3T3H45PTIRYM5DZ473MDWNTBI6J5ZTIBJ7U5PBNNSMOZELQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.980867258 (586h29m7.152985677s) [noise=true , address=212.102.52.217:4426 , piece_id=FMSUUIQ5O6WNN53E7BCOXTCMCB5IYWGND7V34QXPG3LUQ7ZGMYGQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982105087 (586h29m7.154223509s) [noise=true , address=212.102.52.217:4435 , piece_id=KV6Y3AAI6VCRQOYKUY6IXD5VVDK6HC37ZYCFULQVGUTDWZMJNBSA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.982665101 (586h29m7.15478352s) [noise=true , address=212.102.52.216:4410 , piece_id=WPTKL4L6RNECPVCWIVYMDM722ZHCLNFX5S7CZ76N77TEMP36KWWQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.990535575 (586h29m7.162653996s) [noise=true , address=212.102.52.215:4373 , piece_id=EVGG6X5OW5YFWUFBOBNFDWQU4Y7MLOUSO667JC2OV3OIZBI3HYAQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995161692 (586h29m7.167280111s) [noise=true , address=212.102.52.214:4359 , piece_id=O7BIM246MXGA5RWBS2VDR7PIQUB3VTTAV3NZYVF3ZTDNN4ONHC3Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.995700412 (586h29m7.167818836s) [noise=true , address=212.102.52.215:4370 , piece_id=PXJFU6Y4AQXO443XPGKISMGZIYQHCS3BAIHMZW2T5UG3PX7MS3DQ, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996230879 (586h29m7.168349304s) [noise=true , address=212.102.52.215:4374 , piece_id=GTMGE54A5XVEUBN7GSKEDSVCJF66BHSDCX7EYDYCIZQ4SD4WYL4A, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996245229 (586h29m7.168363649s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 16 pieces May 25 05:17:54.996331664 (586h29m7.168450086s) [noise=true , address=212.102.52.213:4327 , piece_id=SVNJFDBFODTIXHTB4FMBB7DSBILNCC6DAZ3YH2QYFCRYJROR5APA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: <nil> May 25 05:17:54.996352673 (586h29m7.168471096s) [seg_pos={0 0}, upload=656637]: Satisfied cohort requirements after 17 pieces May 25 05:17:54.996470463 (586h29m7.168588891s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996482881 (586h29m7.168601306s) [noise=true , address=212.102.52.213:4340 , piece_id=VNMLFNGW2ZB6EXTIZWNR3YKIX5XF44NK2UNVZFSY2XA5FJGQGZ7Q, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996718180 (586h29m7.168836608s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996728166 (586h29m7.168846596s) [noise=true , address=212.102.52.217:4425 , piece_id=5JVK52O7WXXUMF65ZJK677PU5LHFCO5F7XK6ITE6ZEHU6FKKDEJA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996916289 (586h29m7.169034753s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XWuLksvapgVhPYFPZyPbpJhwQY2YDEvHEFGSkU5KP6qfHLZTk): protocol: expected piece hash; context canceled; EOF May 25 05:17:54.996928625 (586h29m7.169047054s) [noise=true , address=212.102.52.217:4440 , piece_id=P24S6IRY645B6DP4AKGZAHPLRJXNDS2KYRLLZOG62SJDBQ2CV3PA, seg_pos={0 0}, upload=656637]: Long tail cancellation due to optimal threshold May 25 05:17:54.996952735 (586h29m7.169071147s) [seg_pos={0 0}, upload=656637]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 05:17:54.997148423 (586h29m7.169266845s) [upload=656637]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:17:54.997158187 (586h29m7.169276616s) [upload=656637]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:18:04.238883032 (586h29m16.411001461s) [upload=656637]: Done uploading segments... May 25 05:18:04.238926366 (586h29m16.41104479s) [upload=656637]: Upload finished. err: <nil> Duration: 1m0.003678127s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.003599813s trace: https://jaeger.dev.storj.io/trace/5caf0568af040bcb FAIL (2026-05-25 05:17:21 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== 33638s) [noise=true , address=212.102.52.217:4428 , piece_id=QSN42APFAWAZB7BUBINZQC2ER6V6LQU2X65KHXI47KHLCSZDKF2Q, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:38.563228363 (586h27m50.73534679s) [noise=true , address=212.102.52.217:4422 , piece_id=JQ3KEZF73BPCFHCCKXCRR4TVFIFVW6UU2QXHTVMGLSH4DKV5MCZQ, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:38.563724590 (586h27m50.735843017s) [noise=true , address=212.102.52.215:4370 , piece_id=45MW2IEZAT7E7PL5PLU724SHLIX4Q625W7BU54GE6MQRY5HK55EA, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:38.564232749 (586h27m50.736351177s) [noise=true , address=212.102.52.216:4407 , piece_id=4PWFXILJPDNNK32DRRJJQRHCEL2GEJDDA24FRIE66SKXZH4LCQQA, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:38.564716424 (586h27m50.736834852s) [noise=true , address=212.102.52.216:4416 , piece_id=MIXH43BIZNDF46ZPFDX5QPYYXXKHVLXNSV7G572RR6JVRNGPJ75A, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:38.565232061 (586h27m50.737350495s) [noise=true , address=212.102.52.214:4361 , piece_id=TB2UKLXCGJPKFQQJBENAYGTVJDBHXC473EBA243TVGMKHMRWGODQ, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:38.565714628 (586h27m50.737833054s) [noise=true , address=212.102.52.215:4392 , piece_id=PRX5S7AAEA7D7UEUXUC5HI7N3AT5RNWEHH5Z4C4NXCMFPX7KT5ZQ, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:38.566511046 (586h27m50.738629478s) [noise=true , address=212.102.52.215:4391 , piece_id=RAFPWHV4KZ3HEEWMDYDEPX6LLEBRVBGJQJFFBUCNJUR2XAJORBCA, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:38.567845224 (586h27m50.739963651s) [noise=true , address=212.102.52.213:4334 , piece_id=PH25JHL5RTYIBYAGOJWFMMBVX3O4N27JCS4GNYHS4RZRZHGNX5HA, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:38.568589706 (586h27m50.740708133s) [noise=true , address=212.102.52.214:4354 , piece_id=5Z4BFZIH23NPDXDMCA2OLI6SWT67Y2W4QH7KSDFODOTQVX2X5VDQ, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:38.570336204 (586h27m50.742454635s) [noise=true , address=212.102.52.214:4367 , piece_id=QQDHR7DICEAV5V5I4IAO3GBVHQOH35S3V7QSJKASY3B2HIZ43MCA, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:38.570446797 (586h27m50.742565465s) [noise=true , address=212.102.52.213:4336 , piece_id=UY4UI34W57UUL6K4JCHP4GO4MGFSMWVLTG5EB7TNL3LSEMRUY6YQ, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:38.571592514 (586h27m50.743710942s) [noise=true , address=212.102.52.213:4333 , piece_id=OG5AFYTYQDHAMLYIPJ6NUU45W6BHLSUG5WQUWNZL6M2MWIPFM3OQ, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:38.572806088 (586h27m50.74492452s) [noise=true , address=212.102.52.213:4323 , piece_id=A54SPY2MY6ASNQNX7WEZKGZIAYI3YL2YQU4OHOZXAYAQ4VVETUXA, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:38.574905354 (586h27m50.747023784s) [noise=true , address=212.102.52.215:4378 , piece_id=BX64WDFFAUQY5D46RJIRMLKRR44OYLO2V6V6I62K66QAJDQAPSIQ, seg_pos={0 0}, upload=656616]: Uploading piece... May 25 05:16:39.081763997 (586h27m51.253882407s) [upload=656616]: Next returned nil segment May 25 05:16:39.081794618 (586h27m51.253913039s) [upload=656616]: Waiting for error group managing segments... May 25 05:16:39.205390932 (586h27m51.377509363s) [noise=true , address=212.102.52.217:4428 , piece_id=QSN42APFAWAZB7BUBINZQC2ER6V6LQU2X65KHXI47KHLCSZDKF2Q, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.206416733 (586h27m51.378535141s) [noise=true , address=212.102.52.214:4348 , piece_id=PMEO3L6H6L2Y5KJHKOJEVY5QLEL4NHXQMB55XMLWUSYIIAQIHIQA, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.207196126 (586h27m51.379314556s) [noise=true , address=212.102.52.215:4378 , piece_id=BX64WDFFAUQY5D46RJIRMLKRR44OYLO2V6V6I62K66QAJDQAPSIQ, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.207338755 (586h27m51.379457175s) [noise=true , address=212.102.52.214:4361 , piece_id=TB2UKLXCGJPKFQQJBENAYGTVJDBHXC473EBA243TVGMKHMRWGODQ, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.208388279 (586h27m51.380506717s) [noise=true , address=212.102.52.215:4391 , piece_id=RAFPWHV4KZ3HEEWMDYDEPX6LLEBRVBGJQJFFBUCNJUR2XAJORBCA, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.208694469 (586h27m51.380812891s) [noise=true , address=212.102.52.216:4416 , piece_id=MIXH43BIZNDF46ZPFDX5QPYYXXKHVLXNSV7G572RR6JVRNGPJ75A, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.209269875 (586h27m51.381388299s) [noise=true , address=212.102.52.213:4334 , piece_id=PH25JHL5RTYIBYAGOJWFMMBVX3O4N27JCS4GNYHS4RZRZHGNX5HA, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.209351211 (586h27m51.381469639s) [noise=true , address=212.102.52.214:4354 , piece_id=5Z4BFZIH23NPDXDMCA2OLI6SWT67Y2W4QH7KSDFODOTQVX2X5VDQ, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.212558606 (586h27m51.384677025s) [noise=true , address=212.102.52.217:4435 , piece_id=VIHZQ2C2FAWRSX6JDFA5TILZLRK44F6OYHYS6TFYVM7446VBH7LQ, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.212715444 (586h27m51.384833873s) [noise=true , address=212.102.52.217:4437 , piece_id=QE7YSKZAADGWA6JZUVOYHRJUFBMC6UMUCFEWBDL5PR2WK4G4222Q, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.213250648 (586h27m51.385369083s) [noise=true , address=212.102.52.213:4336 , piece_id=UY4UI34W57UUL6K4JCHP4GO4MGFSMWVLTG5EB7TNL3LSEMRUY6YQ, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.213845456 (586h27m51.385963883s) [noise=true , address=212.102.52.217:4422 , piece_id=JQ3KEZF73BPCFHCCKXCRR4TVFIFVW6UU2QXHTVMGLSH4DKV5MCZQ, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.214542199 (586h27m51.386660619s) [noise=true , address=212.102.52.215:4392 , piece_id=PRX5S7AAEA7D7UEUXUC5HI7N3AT5RNWEHH5Z4C4NXCMFPX7KT5ZQ, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.214563523 (586h27m51.386681933s) [noise=true , address=212.102.52.216:4408 , piece_id=SCQMQEWNR3X6ALLXDZFWETUMZL6DOBJ4RWIAQXXLQMXP66PWQGAA, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.214690808 (586h27m51.386809235s) [noise=true , address=212.102.52.215:4370 , piece_id=45MW2IEZAT7E7PL5PLU724SHLIX4Q625W7BU54GE6MQRY5HK55EA, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.217223260 (586h27m51.389341691s) [noise=true , address=212.102.52.216:4393 , piece_id=ODOO2C3O5CX5OEOWFXLL4I5N7R44Q7IOVTUAJIOHQKWQHFBWXFKQ, seg_pos={0 0}, upload=656616]: Done uploading piece. err: <nil> May 25 05:16:39.217247719 (586h27m51.389366149s) [seg_pos={0 0}, upload=656616]: Satisfied cohort requirements after 16 pieces May 25 05:16:39.217765749 (586h27m51.389884177s) [noise=true , address=212.102.52.216:4407 , piece_id=4PWFXILJPDNNK32DRRJJQRHCEL2GEJDDA24FRIE66SKXZH4LCQQA, seg_pos={0 0}, upload=656616]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12GVGZ5AsUeSjou5J2AGU7913SpaVzd317SRL5dYKTkfE4w489N): protocol: expected piece hash; context canceled; EOF May 25 05:16:39.217781217 (586h27m51.389899643s) [noise=true , address=212.102.52.216:4407 , piece_id=4PWFXILJPDNNK32DRRJJQRHCEL2GEJDDA24FRIE66SKXZH4LCQQA, seg_pos={0 0}, upload=656616]: Long tail cancellation due to optimal threshold May 25 05:16:39.217802270 (586h27m51.389920676s) [noise=true , address=212.102.52.213:4323 , piece_id=A54SPY2MY6ASNQNX7WEZKGZIAYI3YL2YQU4OHOZXAYAQ4VVETUXA, seg_pos={0 0}, upload=656616]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nvo4dwVwbPtVveYYjpPEpZBSgnt1Q4tWSdckbRqZyZdxUA4s3): protocol: expected piece hash; context canceled; EOF May 25 05:16:39.217811753 (586h27m51.389930177s) [noise=true , address=212.102.52.213:4323 , piece_id=A54SPY2MY6ASNQNX7WEZKGZIAYI3YL2YQU4OHOZXAYAQ4VVETUXA, seg_pos={0 0}, upload=656616]: Long tail cancellation due to optimal threshold May 25 05:16:39.218006078 (586h27m51.390124503s) [noise=true , address=212.102.52.213:4333 , piece_id=OG5AFYTYQDHAMLYIPJ6NUU45W6BHLSUG5WQUWNZL6M2MWIPFM3OQ, seg_pos={0 0}, upload=656616]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Gm3eZxZPxPeHqLQ32kpXMpCgnwRoP8epBYtiFF1EH3U9LEazY): protocol: expected piece hash; context canceled; EOF May 25 05:16:39.218013696 (586h27m51.390132115s) [noise=true , address=212.102.52.213:4333 , piece_id=OG5AFYTYQDHAMLYIPJ6NUU45W6BHLSUG5WQUWNZL6M2MWIPFM3OQ, seg_pos={0 0}, upload=656616]: Long tail cancellation due to optimal threshold May 25 05:16:39.218171939 (586h27m51.390290368s) [noise=true , address=212.102.52.214:4367 , piece_id=QQDHR7DICEAV5V5I4IAO3GBVHQOH35S3V7QSJKASY3B2HIZ43MCA, seg_pos={0 0}, upload=656616]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gm8ZFEuFM9SdzCZ3LsdyTM95KenMv7SAiK7dpgqj6Y7uKPyGo): protocol: expected piece hash; context canceled; EOF May 25 05:16:39.218179497 (586h27m51.390297926s) [noise=true , address=212.102.52.214:4367 , piece_id=QQDHR7DICEAV5V5I4IAO3GBVHQOH35S3V7QSJKASY3B2HIZ43MCA, seg_pos={0 0}, upload=656616]: Long tail cancellation due to optimal threshold May 25 05:16:39.218205505 (586h27m51.390323925s) [seg_pos={0 0}, upload=656616]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 05:16:39.218474079 (586h27m51.390592498s) [upload=656616]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:16:39.218481859 (586h27m51.390600279s) [upload=656616]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:17:19.994901619 (586h28m32.167020059s) [upload=656616]: Done uploading segments... May 25 05:17:19.994949901 (586h28m32.167068322s) [upload=656616]: Upload finished. err: <nil> Duration: 1m0.003635316s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.577480612s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:29:01 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.577500748s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.693465209s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:28:15 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.693493428s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.592894022s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:27:21 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.592928639s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.652131298s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:26:08 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.652168198s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.640228519s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:25:41 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.640278222s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.656707957s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:24:42 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.656741617s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.645764591s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:23:38 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.645797855s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.679639321s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:23:05 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.679719727s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.604575656s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:22:12 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.604602863s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.671595655s trace: https://jaeger.dev.storj.io/trace/532a36b8a7dcd312 FAIL (2026-05-25 03:21:19 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.671631995s core uplink eu1

Orbiter Check History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.remote)