Orbiter History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [....................X..X....................................] duration: 2.096852324s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:51:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.096880068s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.....................X..X...................................] duration: 5.639412548s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:50:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.639445821s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [......................X..X..................................] duration: 1.97494055s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:49:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.974975282s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.......................X..X.................................] duration: 2.215266568s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:49:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.21530254s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [........................X..X................................] duration: 2.001510652s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:48:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.00153587s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.........................X..X...............................] duration: 1.932545171s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:48:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.932652408s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..........................X..X..............................] duration: 2.067632705s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:48:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.067660244s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...........................X..X.............................] duration: 2.129475178s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:47:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.129508319s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [............................X..X............................] duration: 1.987192204s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:46:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.987237067s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.............................X..X...........................] duration: 5.408006847s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:46:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.408041321s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..............................X..X..........................] duration: 2.013540539s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:45:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.013571067s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...............................X..X.........................] duration: 1.90466433s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:44:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.904697787s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [................................X..X........................] duration: 2.337398266s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:43:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.3374586s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.................................X..X.......................] duration: 7.190059567s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:42:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 7.190098876s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..................................X..X......................] duration: 2.189871082s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:41:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.189906973s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...................................X..X.....................] duration: 1.975077281s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:40:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.975110802s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [....................................X..X....................] duration: 2.001956833s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:39:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.001989076s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X..X...................] duration: 1.923076967s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:38:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.923109336s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [......................................X..X..................] duration: 2.659058078s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:38:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.65908921s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X..X.................] duration: 2.436474078s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:37:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.436579073s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [........................................X..X................] duration: 1.96267885s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:37:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.962783713s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X..X...............] duration: 2.123442884s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:37:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.123936561s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X..X..............] duration: 2.383715399s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:36:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.383738962s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...........................................X..X.............] duration: 2.077152356s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:35:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.077189821s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [............................................X..X............] duration: 2.133175157s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:35:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.133284342s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.............................................X..X...........] duration: 1.981013894s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:34:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.981044899s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..............................................X..X..........] duration: 2.031490257s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:33:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.031521864s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...............................................X..X.........] duration: 1.972625575s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:33:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.972670681s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [................................................X..X........] duration: 2.005797421s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:32:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.005820692s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.................................................X..X.......] duration: 31.422904062s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:32:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 31.42292799s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..................................................X..X......] duration: 2.213412031s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:31:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.213453758s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...................................................X..X.....] duration: 2.270302177s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:29:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.270335832s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [....................................................X..X....] duration: 2.062244343s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:28:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.062341413s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.....................................................X..X...] duration: 1.959147386s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:28:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.959180301s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [......................................................X..X..] duration: 2.27100731s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:27:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.27110185s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.......................................................X..X.] duration: 2.04592008s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:26:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.045948211s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [........................................................X..X] duration: 1m59.465123032s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:26:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 1m59.465147045s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 3.5217958s trace: https://jaeger.dev.storj.io/trace/613d14d6c33d37e0 FAIL (2026-05-25 08:23:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 212.102.52.216:4415 , piece_id=Z6NEA7KBMKR5WMUYPWEO5PDJMX42IRC3IWJRTVMSGYHFNOKDPLWA, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.030542326 (589h33m45.202660756s) [noise=true , address=212.102.52.217:4423 , piece_id=34RCCBFP2YOCFKG4EPAJLPOR75V4XVUVUNDPLSA2RCEV773KMWDA, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.031284135 (589h33m45.203402565s) [noise=true , address=212.102.52.213:4333 , piece_id=MRKV7AJCGLGYDQF27CETL73C6DS3OSLHDAS2SRGSITQPNHG6FR2Q, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.031993512 (589h33m45.204111932s) [noise=true , address=212.102.52.216:4400 , piece_id=KTXP2PGFK6GW347MRFHCLXOWAIBMKLBJVEBDMU63XKHUR65EI7VQ, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.032676140 (589h33m45.20479457s) [noise=true , address=212.102.52.214:4363 , piece_id=7ELGMBOZJQR2TR5FD5CYKFBWDAFBRR4FFSNMZJLFLQ556TQKEZFQ, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.033260280 (589h33m45.205378711s) [noise=true , address=212.102.52.213:4340 , piece_id=JHX3VX4QX652BPUGAOQOE2ILFO4KX2TWCWOHSPGWF7DSYSFJOQ4Q, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.034607627 (589h33m45.206726058s) [noise=true , address=212.102.52.215:4391 , piece_id=QVDW63WXRWANRT7COCIB42VV6Q4YE6V4OAALKYS7UUDPJLN53HIA, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.035208539 (589h33m45.207326969s) [noise=true , address=212.102.52.217:4433 , piece_id=CH5LHYOHQQRYSBTTTXU5HHTKUXFIGIW7CSRXLUY3XTEWVVOFJSJQ, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.036967846 (589h33m45.209086276s) [noise=true , address=212.102.52.214:4349 , piece_id=DK6N6HJSYAI3VWKV4VZJTUEYQBH6WK6DRZKWGLWP3PLK2CTDTN2A, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.037195953 (589h33m45.209314385s) [noise=true , address=212.102.52.217:4425 , piece_id=6CNTJSUOTFA4BVVMKKP4VHWMTDTC5F4RSHV3NA6565SZ6UZW5A4A, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.039280976 (589h33m45.211399405s) [noise=true , address=212.102.52.215:4388 , piece_id=PGLJNQTC7PBNBDG477PJW3ZP6WMHBWYFURBN3344LVMFZ2WSVTQA, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.041665308 (589h33m45.213783738s) [noise=true , address=212.102.52.215:4377 , piece_id=SRWBDGFL4EHYKZ7SKAG5VWZODY2PQY7J6OENSDBGBK4RYZAT34JQ, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.062570993 (589h33m45.234689424s) [noise=true , address=212.102.52.214:4348 , piece_id=YLMXVK2WSW5DMEUG5L7PG4HY4B4JQCBMVFDMFNI67NXLCHTZSTEA, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.062810997 (589h33m45.234929426s) [noise=true , address=212.102.52.214:4366 , piece_id=77K3BYSFF3ULBA3W2LM5CKXHMNDRM5B7DBZI6WWNQEVGIFTKMA5Q, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.064750547 (589h33m45.236868975s) [noise=true , address=212.102.52.215:4378 , piece_id=SJLJ6I6MZ3H7BAKUDUEWBC2ZUFUISAYJYOWIAUUGPDH5MU2V2JBQ, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.529422225 (589h33m45.701540634s) [upload=660090]: Next returned nil segment May 25 08:22:33.529462080 (589h33m45.7015805s) [upload=660090]: Waiting for error group managing segments... May 25 08:22:33.646333089 (589h33m45.818451515s) [noise=true , address=212.102.52.216:4395 , piece_id=OTRLVIEEP5ZIQJHIT3A3QACHNBE3C46XOZN4DSL6EGHUBMATPMZA, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.646459717 (589h33m45.818578139s) [noise=true , address=212.102.52.214:4363 , piece_id=7ELGMBOZJQR2TR5FD5CYKFBWDAFBRR4FFSNMZJLFLQ556TQKEZFQ, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.648509474 (589h33m45.820628319s) [noise=true , address=212.102.52.216:4415 , piece_id=Z6NEA7KBMKR5WMUYPWEO5PDJMX42IRC3IWJRTVMSGYHFNOKDPLWA, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.650322512 (589h33m45.82244094s) [noise=true , address=212.102.52.213:4343 , piece_id=AP5ULMVDIAFZUJILW7232EVPFLXJ6SGYTJSBZRGESHXRRDEPS7OA, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.650499543 (589h33m45.822617955s) [noise=true , address=212.102.52.216:4400 , piece_id=KTXP2PGFK6GW347MRFHCLXOWAIBMKLBJVEBDMU63XKHUR65EI7VQ, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.651718620 (589h33m45.823837045s) [noise=true , address=212.102.52.217:4437 , piece_id=X2GGLMEBLY5QUDIPWHZVYAVLPT76NWRPGY772KS5DIPGJ3JB6ZSA, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.652469411 (589h33m45.824587834s) [noise=true , address=212.102.52.217:4425 , piece_id=6CNTJSUOTFA4BVVMKKP4VHWMTDTC5F4RSHV3NA6565SZ6UZW5A4A, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.653137087 (589h33m45.82525551s) [noise=true , address=212.102.52.215:4378 , piece_id=SJLJ6I6MZ3H7BAKUDUEWBC2ZUFUISAYJYOWIAUUGPDH5MU2V2JBQ, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.654373102 (589h33m45.826491525s) [noise=true , address=212.102.52.214:4366 , piece_id=77K3BYSFF3ULBA3W2LM5CKXHMNDRM5B7DBZI6WWNQEVGIFTKMA5Q, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.655265757 (589h33m45.827384166s) [noise=true , address=212.102.52.216:4394 , piece_id=MVTLOLFH2WDPXWJ77Q6CI5QRGFA25BALL4OYGSI5GZJXQDQO7JMA, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.656221676 (589h33m45.828340082s) [noise=true , address=212.102.52.213:4333 , piece_id=MRKV7AJCGLGYDQF27CETL73C6DS3OSLHDAS2SRGSITQPNHG6FR2Q, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.659101702 (589h33m45.831220125s) [noise=true , address=212.102.52.217:4423 , piece_id=34RCCBFP2YOCFKG4EPAJLPOR75V4XVUVUNDPLSA2RCEV773KMWDA, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.661776309 (589h33m45.83389473s) [noise=true , address=212.102.52.214:4348 , piece_id=YLMXVK2WSW5DMEUG5L7PG4HY4B4JQCBMVFDMFNI67NXLCHTZSTEA, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.665016333 (589h33m45.837134752s) [noise=true , address=212.102.52.215:4377 , piece_id=SRWBDGFL4EHYKZ7SKAG5VWZODY2PQY7J6OENSDBGBK4RYZAT34JQ, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.666629541 (589h33m45.838747961s) [noise=true , address=212.102.52.213:4330 , piece_id=XD57WBETCK5BCGFPHK55FEJY2RTUUKFY4Q25HPV7OT7CNA5IOJTQ, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.667920389 (589h33m45.840038795s) [noise=true , address=212.102.52.217:4433 , piece_id=CH5LHYOHQQRYSBTTTXU5HHTKUXFIGIW7CSRXLUY3XTEWVVOFJSJQ, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.667942947 (589h33m45.840061377s) [seg_pos={0 0}, upload=660090]: Satisfied cohort requirements after 16 pieces May 25 08:22:33.668229717 (589h33m45.840348146s) [noise=true , address=212.102.52.215:4388 , piece_id=PGLJNQTC7PBNBDG477PJW3ZP6WMHBWYFURBN3344LVMFZ2WSVTQA, seg_pos={0 0}, upload=660090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VK5hn1TRuMk5ZXTat7nmjx4kXZec3RDyQ89iQrrrRzVh2xPVF): protocol: expected piece hash; context canceled; EOF May 25 08:22:33.668241885 (589h33m45.840360321s) [noise=true , address=212.102.52.215:4388 , piece_id=PGLJNQTC7PBNBDG477PJW3ZP6WMHBWYFURBN3344LVMFZ2WSVTQA, seg_pos={0 0}, upload=660090]: Long tail cancellation due to optimal threshold May 25 08:22:33.668258526 (589h33m45.840376933s) [noise=true , address=212.102.52.213:4340 , piece_id=JHX3VX4QX652BPUGAOQOE2ILFO4KX2TWCWOHSPGWF7DSYSFJOQ4Q, seg_pos={0 0}, upload=660090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 08:22:33.668268182 (589h33m45.840386609s) [noise=true , address=212.102.52.213:4340 , piece_id=JHX3VX4QX652BPUGAOQOE2ILFO4KX2TWCWOHSPGWF7DSYSFJOQ4Q, seg_pos={0 0}, upload=660090]: Long tail cancellation due to optimal threshold May 25 08:22:33.668431293 (589h33m45.840549723s) [noise=true , address=212.102.52.215:4391 , piece_id=QVDW63WXRWANRT7COCIB42VV6Q4YE6V4OAALKYS7UUDPJLN53HIA, seg_pos={0 0}, upload=660090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jv7h914FvJFDZb7qftHR4eNn5dnzYuJnnCg3hNRAfo6rWVcoc): protocol: expected piece hash; context canceled; EOF May 25 08:22:33.668439799 (589h33m45.840558235s) [noise=true , address=212.102.52.215:4391 , piece_id=QVDW63WXRWANRT7COCIB42VV6Q4YE6V4OAALKYS7UUDPJLN53HIA, seg_pos={0 0}, upload=660090]: Long tail cancellation due to optimal threshold May 25 08:22:33.668674399 (589h33m45.840792827s) [noise=true , address=212.102.52.214:4349 , piece_id=DK6N6HJSYAI3VWKV4VZJTUEYQBH6WK6DRZKWGLWP3PLK2CTDTN2A, seg_pos={0 0}, upload=660090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF May 25 08:22:33.668684443 (589h33m45.840802873s) [noise=true , address=212.102.52.214:4349 , piece_id=DK6N6HJSYAI3VWKV4VZJTUEYQBH6WK6DRZKWGLWP3PLK2CTDTN2A, seg_pos={0 0}, upload=660090]: Long tail cancellation due to optimal threshold May 25 08:22:33.668711669 (589h33m45.840830089s) [seg_pos={0 0}, upload=660090]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:22:33.668806874 (589h33m45.840925303s) [upload=660090]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:22:33.668812421 (589h33m45.840930844s) [upload=660090]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:23:22.758894005 (589h34m34.931012438s) [upload=660090]: Done uploading segments... May 25 08:23:22.759053082 (589h34m34.931171509s) [upload=660090]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.521821338s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 1.972584529s trace: https://jaeger.dev.storj.io/trace/613d14d6c33d37e0 FAIL (2026-05-25 08:23:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 212.102.52.216:4415 , piece_id=Z6NEA7KBMKR5WMUYPWEO5PDJMX42IRC3IWJRTVMSGYHFNOKDPLWA, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.030542326 (589h33m45.202660756s) [noise=true , address=212.102.52.217:4423 , piece_id=34RCCBFP2YOCFKG4EPAJLPOR75V4XVUVUNDPLSA2RCEV773KMWDA, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.031284135 (589h33m45.203402565s) [noise=true , address=212.102.52.213:4333 , piece_id=MRKV7AJCGLGYDQF27CETL73C6DS3OSLHDAS2SRGSITQPNHG6FR2Q, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.031993512 (589h33m45.204111932s) [noise=true , address=212.102.52.216:4400 , piece_id=KTXP2PGFK6GW347MRFHCLXOWAIBMKLBJVEBDMU63XKHUR65EI7VQ, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.032676140 (589h33m45.20479457s) [noise=true , address=212.102.52.214:4363 , piece_id=7ELGMBOZJQR2TR5FD5CYKFBWDAFBRR4FFSNMZJLFLQ556TQKEZFQ, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.033260280 (589h33m45.205378711s) [noise=true , address=212.102.52.213:4340 , piece_id=JHX3VX4QX652BPUGAOQOE2ILFO4KX2TWCWOHSPGWF7DSYSFJOQ4Q, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.034607627 (589h33m45.206726058s) [noise=true , address=212.102.52.215:4391 , piece_id=QVDW63WXRWANRT7COCIB42VV6Q4YE6V4OAALKYS7UUDPJLN53HIA, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.035208539 (589h33m45.207326969s) [noise=true , address=212.102.52.217:4433 , piece_id=CH5LHYOHQQRYSBTTTXU5HHTKUXFIGIW7CSRXLUY3XTEWVVOFJSJQ, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.036967846 (589h33m45.209086276s) [noise=true , address=212.102.52.214:4349 , piece_id=DK6N6HJSYAI3VWKV4VZJTUEYQBH6WK6DRZKWGLWP3PLK2CTDTN2A, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.037195953 (589h33m45.209314385s) [noise=true , address=212.102.52.217:4425 , piece_id=6CNTJSUOTFA4BVVMKKP4VHWMTDTC5F4RSHV3NA6565SZ6UZW5A4A, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.039280976 (589h33m45.211399405s) [noise=true , address=212.102.52.215:4388 , piece_id=PGLJNQTC7PBNBDG477PJW3ZP6WMHBWYFURBN3344LVMFZ2WSVTQA, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.041665308 (589h33m45.213783738s) [noise=true , address=212.102.52.215:4377 , piece_id=SRWBDGFL4EHYKZ7SKAG5VWZODY2PQY7J6OENSDBGBK4RYZAT34JQ, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.062570993 (589h33m45.234689424s) [noise=true , address=212.102.52.214:4348 , piece_id=YLMXVK2WSW5DMEUG5L7PG4HY4B4JQCBMVFDMFNI67NXLCHTZSTEA, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.062810997 (589h33m45.234929426s) [noise=true , address=212.102.52.214:4366 , piece_id=77K3BYSFF3ULBA3W2LM5CKXHMNDRM5B7DBZI6WWNQEVGIFTKMA5Q, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.064750547 (589h33m45.236868975s) [noise=true , address=212.102.52.215:4378 , piece_id=SJLJ6I6MZ3H7BAKUDUEWBC2ZUFUISAYJYOWIAUUGPDH5MU2V2JBQ, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.529422225 (589h33m45.701540634s) [upload=660090]: Next returned nil segment May 25 08:22:33.529462080 (589h33m45.7015805s) [upload=660090]: Waiting for error group managing segments... May 25 08:22:33.646333089 (589h33m45.818451515s) [noise=true , address=212.102.52.216:4395 , piece_id=OTRLVIEEP5ZIQJHIT3A3QACHNBE3C46XOZN4DSL6EGHUBMATPMZA, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.646459717 (589h33m45.818578139s) [noise=true , address=212.102.52.214:4363 , piece_id=7ELGMBOZJQR2TR5FD5CYKFBWDAFBRR4FFSNMZJLFLQ556TQKEZFQ, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.648509474 (589h33m45.820628319s) [noise=true , address=212.102.52.216:4415 , piece_id=Z6NEA7KBMKR5WMUYPWEO5PDJMX42IRC3IWJRTVMSGYHFNOKDPLWA, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.650322512 (589h33m45.82244094s) [noise=true , address=212.102.52.213:4343 , piece_id=AP5ULMVDIAFZUJILW7232EVPFLXJ6SGYTJSBZRGESHXRRDEPS7OA, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.650499543 (589h33m45.822617955s) [noise=true , address=212.102.52.216:4400 , piece_id=KTXP2PGFK6GW347MRFHCLXOWAIBMKLBJVEBDMU63XKHUR65EI7VQ, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.651718620 (589h33m45.823837045s) [noise=true , address=212.102.52.217:4437 , piece_id=X2GGLMEBLY5QUDIPWHZVYAVLPT76NWRPGY772KS5DIPGJ3JB6ZSA, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.652469411 (589h33m45.824587834s) [noise=true , address=212.102.52.217:4425 , piece_id=6CNTJSUOTFA4BVVMKKP4VHWMTDTC5F4RSHV3NA6565SZ6UZW5A4A, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.653137087 (589h33m45.82525551s) [noise=true , address=212.102.52.215:4378 , piece_id=SJLJ6I6MZ3H7BAKUDUEWBC2ZUFUISAYJYOWIAUUGPDH5MU2V2JBQ, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.654373102 (589h33m45.826491525s) [noise=true , address=212.102.52.214:4366 , piece_id=77K3BYSFF3ULBA3W2LM5CKXHMNDRM5B7DBZI6WWNQEVGIFTKMA5Q, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.655265757 (589h33m45.827384166s) [noise=true , address=212.102.52.216:4394 , piece_id=MVTLOLFH2WDPXWJ77Q6CI5QRGFA25BALL4OYGSI5GZJXQDQO7JMA, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.656221676 (589h33m45.828340082s) [noise=true , address=212.102.52.213:4333 , piece_id=MRKV7AJCGLGYDQF27CETL73C6DS3OSLHDAS2SRGSITQPNHG6FR2Q, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.659101702 (589h33m45.831220125s) [noise=true , address=212.102.52.217:4423 , piece_id=34RCCBFP2YOCFKG4EPAJLPOR75V4XVUVUNDPLSA2RCEV773KMWDA, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.661776309 (589h33m45.83389473s) [noise=true , address=212.102.52.214:4348 , piece_id=YLMXVK2WSW5DMEUG5L7PG4HY4B4JQCBMVFDMFNI67NXLCHTZSTEA, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.665016333 (589h33m45.837134752s) [noise=true , address=212.102.52.215:4377 , piece_id=SRWBDGFL4EHYKZ7SKAG5VWZODY2PQY7J6OENSDBGBK4RYZAT34JQ, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.666629541 (589h33m45.838747961s) [noise=true , address=212.102.52.213:4330 , piece_id=XD57WBETCK5BCGFPHK55FEJY2RTUUKFY4Q25HPV7OT7CNA5IOJTQ, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.667920389 (589h33m45.840038795s) [noise=true , address=212.102.52.217:4433 , piece_id=CH5LHYOHQQRYSBTTTXU5HHTKUXFIGIW7CSRXLUY3XTEWVVOFJSJQ, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.667942947 (589h33m45.840061377s) [seg_pos={0 0}, upload=660090]: Satisfied cohort requirements after 16 pieces May 25 08:22:33.668229717 (589h33m45.840348146s) [noise=true , address=212.102.52.215:4388 , piece_id=PGLJNQTC7PBNBDG477PJW3ZP6WMHBWYFURBN3344LVMFZ2WSVTQA, seg_pos={0 0}, upload=660090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VK5hn1TRuMk5ZXTat7nmjx4kXZec3RDyQ89iQrrrRzVh2xPVF): protocol: expected piece hash; context canceled; EOF May 25 08:22:33.668241885 (589h33m45.840360321s) [noise=true , address=212.102.52.215:4388 , piece_id=PGLJNQTC7PBNBDG477PJW3ZP6WMHBWYFURBN3344LVMFZ2WSVTQA, seg_pos={0 0}, upload=660090]: Long tail cancellation due to optimal threshold May 25 08:22:33.668258526 (589h33m45.840376933s) [noise=true , address=212.102.52.213:4340 , piece_id=JHX3VX4QX652BPUGAOQOE2ILFO4KX2TWCWOHSPGWF7DSYSFJOQ4Q, seg_pos={0 0}, upload=660090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 08:22:33.668268182 (589h33m45.840386609s) [noise=true , address=212.102.52.213:4340 , piece_id=JHX3VX4QX652BPUGAOQOE2ILFO4KX2TWCWOHSPGWF7DSYSFJOQ4Q, seg_pos={0 0}, upload=660090]: Long tail cancellation due to optimal threshold May 25 08:22:33.668431293 (589h33m45.840549723s) [noise=true , address=212.102.52.215:4391 , piece_id=QVDW63WXRWANRT7COCIB42VV6Q4YE6V4OAALKYS7UUDPJLN53HIA, seg_pos={0 0}, upload=660090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jv7h914FvJFDZb7qftHR4eNn5dnzYuJnnCg3hNRAfo6rWVcoc): protocol: expected piece hash; context canceled; EOF May 25 08:22:33.668439799 (589h33m45.840558235s) [noise=true , address=212.102.52.215:4391 , piece_id=QVDW63WXRWANRT7COCIB42VV6Q4YE6V4OAALKYS7UUDPJLN53HIA, seg_pos={0 0}, upload=660090]: Long tail cancellation due to optimal threshold May 25 08:22:33.668674399 (589h33m45.840792827s) [noise=true , address=212.102.52.214:4349 , piece_id=DK6N6HJSYAI3VWKV4VZJTUEYQBH6WK6DRZKWGLWP3PLK2CTDTN2A, seg_pos={0 0}, upload=660090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF May 25 08:22:33.668684443 (589h33m45.840802873s) [noise=true , address=212.102.52.214:4349 , piece_id=DK6N6HJSYAI3VWKV4VZJTUEYQBH6WK6DRZKWGLWP3PLK2CTDTN2A, seg_pos={0 0}, upload=660090]: Long tail cancellation due to optimal threshold May 25 08:22:33.668711669 (589h33m45.840830089s) [seg_pos={0 0}, upload=660090]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:22:33.668806874 (589h33m45.840925303s) [upload=660090]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:22:33.668812421 (589h33m45.840930844s) [upload=660090]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:23:22.758894005 (589h34m34.931012438s) [upload=660090]: Done uploading segments... May 25 08:23:22.759053082 (589h34m34.931171509s) [upload=660090]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.972621381s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m16.726573682s trace: https://jaeger.dev.storj.io/trace/613d14d6c33d37e0 FAIL (2026-05-25 08:23:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 212.102.52.216:4415 , piece_id=Z6NEA7KBMKR5WMUYPWEO5PDJMX42IRC3IWJRTVMSGYHFNOKDPLWA, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.030542326 (589h33m45.202660756s) [noise=true , address=212.102.52.217:4423 , piece_id=34RCCBFP2YOCFKG4EPAJLPOR75V4XVUVUNDPLSA2RCEV773KMWDA, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.031284135 (589h33m45.203402565s) [noise=true , address=212.102.52.213:4333 , piece_id=MRKV7AJCGLGYDQF27CETL73C6DS3OSLHDAS2SRGSITQPNHG6FR2Q, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.031993512 (589h33m45.204111932s) [noise=true , address=212.102.52.216:4400 , piece_id=KTXP2PGFK6GW347MRFHCLXOWAIBMKLBJVEBDMU63XKHUR65EI7VQ, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.032676140 (589h33m45.20479457s) [noise=true , address=212.102.52.214:4363 , piece_id=7ELGMBOZJQR2TR5FD5CYKFBWDAFBRR4FFSNMZJLFLQ556TQKEZFQ, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.033260280 (589h33m45.205378711s) [noise=true , address=212.102.52.213:4340 , piece_id=JHX3VX4QX652BPUGAOQOE2ILFO4KX2TWCWOHSPGWF7DSYSFJOQ4Q, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.034607627 (589h33m45.206726058s) [noise=true , address=212.102.52.215:4391 , piece_id=QVDW63WXRWANRT7COCIB42VV6Q4YE6V4OAALKYS7UUDPJLN53HIA, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.035208539 (589h33m45.207326969s) [noise=true , address=212.102.52.217:4433 , piece_id=CH5LHYOHQQRYSBTTTXU5HHTKUXFIGIW7CSRXLUY3XTEWVVOFJSJQ, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.036967846 (589h33m45.209086276s) [noise=true , address=212.102.52.214:4349 , piece_id=DK6N6HJSYAI3VWKV4VZJTUEYQBH6WK6DRZKWGLWP3PLK2CTDTN2A, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.037195953 (589h33m45.209314385s) [noise=true , address=212.102.52.217:4425 , piece_id=6CNTJSUOTFA4BVVMKKP4VHWMTDTC5F4RSHV3NA6565SZ6UZW5A4A, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.039280976 (589h33m45.211399405s) [noise=true , address=212.102.52.215:4388 , piece_id=PGLJNQTC7PBNBDG477PJW3ZP6WMHBWYFURBN3344LVMFZ2WSVTQA, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.041665308 (589h33m45.213783738s) [noise=true , address=212.102.52.215:4377 , piece_id=SRWBDGFL4EHYKZ7SKAG5VWZODY2PQY7J6OENSDBGBK4RYZAT34JQ, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.062570993 (589h33m45.234689424s) [noise=true , address=212.102.52.214:4348 , piece_id=YLMXVK2WSW5DMEUG5L7PG4HY4B4JQCBMVFDMFNI67NXLCHTZSTEA, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.062810997 (589h33m45.234929426s) [noise=true , address=212.102.52.214:4366 , piece_id=77K3BYSFF3ULBA3W2LM5CKXHMNDRM5B7DBZI6WWNQEVGIFTKMA5Q, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.064750547 (589h33m45.236868975s) [noise=true , address=212.102.52.215:4378 , piece_id=SJLJ6I6MZ3H7BAKUDUEWBC2ZUFUISAYJYOWIAUUGPDH5MU2V2JBQ, seg_pos={0 0}, upload=660090]: Uploading piece... May 25 08:22:33.529422225 (589h33m45.701540634s) [upload=660090]: Next returned nil segment May 25 08:22:33.529462080 (589h33m45.7015805s) [upload=660090]: Waiting for error group managing segments... May 25 08:22:33.646333089 (589h33m45.818451515s) [noise=true , address=212.102.52.216:4395 , piece_id=OTRLVIEEP5ZIQJHIT3A3QACHNBE3C46XOZN4DSL6EGHUBMATPMZA, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.646459717 (589h33m45.818578139s) [noise=true , address=212.102.52.214:4363 , piece_id=7ELGMBOZJQR2TR5FD5CYKFBWDAFBRR4FFSNMZJLFLQ556TQKEZFQ, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.648509474 (589h33m45.820628319s) [noise=true , address=212.102.52.216:4415 , piece_id=Z6NEA7KBMKR5WMUYPWEO5PDJMX42IRC3IWJRTVMSGYHFNOKDPLWA, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.650322512 (589h33m45.82244094s) [noise=true , address=212.102.52.213:4343 , piece_id=AP5ULMVDIAFZUJILW7232EVPFLXJ6SGYTJSBZRGESHXRRDEPS7OA, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.650499543 (589h33m45.822617955s) [noise=true , address=212.102.52.216:4400 , piece_id=KTXP2PGFK6GW347MRFHCLXOWAIBMKLBJVEBDMU63XKHUR65EI7VQ, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.651718620 (589h33m45.823837045s) [noise=true , address=212.102.52.217:4437 , piece_id=X2GGLMEBLY5QUDIPWHZVYAVLPT76NWRPGY772KS5DIPGJ3JB6ZSA, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.652469411 (589h33m45.824587834s) [noise=true , address=212.102.52.217:4425 , piece_id=6CNTJSUOTFA4BVVMKKP4VHWMTDTC5F4RSHV3NA6565SZ6UZW5A4A, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.653137087 (589h33m45.82525551s) [noise=true , address=212.102.52.215:4378 , piece_id=SJLJ6I6MZ3H7BAKUDUEWBC2ZUFUISAYJYOWIAUUGPDH5MU2V2JBQ, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.654373102 (589h33m45.826491525s) [noise=true , address=212.102.52.214:4366 , piece_id=77K3BYSFF3ULBA3W2LM5CKXHMNDRM5B7DBZI6WWNQEVGIFTKMA5Q, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.655265757 (589h33m45.827384166s) [noise=true , address=212.102.52.216:4394 , piece_id=MVTLOLFH2WDPXWJ77Q6CI5QRGFA25BALL4OYGSI5GZJXQDQO7JMA, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.656221676 (589h33m45.828340082s) [noise=true , address=212.102.52.213:4333 , piece_id=MRKV7AJCGLGYDQF27CETL73C6DS3OSLHDAS2SRGSITQPNHG6FR2Q, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.659101702 (589h33m45.831220125s) [noise=true , address=212.102.52.217:4423 , piece_id=34RCCBFP2YOCFKG4EPAJLPOR75V4XVUVUNDPLSA2RCEV773KMWDA, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.661776309 (589h33m45.83389473s) [noise=true , address=212.102.52.214:4348 , piece_id=YLMXVK2WSW5DMEUG5L7PG4HY4B4JQCBMVFDMFNI67NXLCHTZSTEA, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.665016333 (589h33m45.837134752s) [noise=true , address=212.102.52.215:4377 , piece_id=SRWBDGFL4EHYKZ7SKAG5VWZODY2PQY7J6OENSDBGBK4RYZAT34JQ, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.666629541 (589h33m45.838747961s) [noise=true , address=212.102.52.213:4330 , piece_id=XD57WBETCK5BCGFPHK55FEJY2RTUUKFY4Q25HPV7OT7CNA5IOJTQ, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.667920389 (589h33m45.840038795s) [noise=true , address=212.102.52.217:4433 , piece_id=CH5LHYOHQQRYSBTTTXU5HHTKUXFIGIW7CSRXLUY3XTEWVVOFJSJQ, seg_pos={0 0}, upload=660090]: Done uploading piece. err: <nil> May 25 08:22:33.667942947 (589h33m45.840061377s) [seg_pos={0 0}, upload=660090]: Satisfied cohort requirements after 16 pieces May 25 08:22:33.668229717 (589h33m45.840348146s) [noise=true , address=212.102.52.215:4388 , piece_id=PGLJNQTC7PBNBDG477PJW3ZP6WMHBWYFURBN3344LVMFZ2WSVTQA, seg_pos={0 0}, upload=660090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12VK5hn1TRuMk5ZXTat7nmjx4kXZec3RDyQ89iQrrrRzVh2xPVF): protocol: expected piece hash; context canceled; EOF May 25 08:22:33.668241885 (589h33m45.840360321s) [noise=true , address=212.102.52.215:4388 , piece_id=PGLJNQTC7PBNBDG477PJW3ZP6WMHBWYFURBN3344LVMFZ2WSVTQA, seg_pos={0 0}, upload=660090]: Long tail cancellation due to optimal threshold May 25 08:22:33.668258526 (589h33m45.840376933s) [noise=true , address=212.102.52.213:4340 , piece_id=JHX3VX4QX652BPUGAOQOE2ILFO4KX2TWCWOHSPGWF7DSYSFJOQ4Q, seg_pos={0 0}, upload=660090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1249tzbqbK8Hmch1EkBQ28yVUNWx11vv7Zf8FtqrkTjEhJtuSGM): protocol: expected piece hash; context canceled; EOF May 25 08:22:33.668268182 (589h33m45.840386609s) [noise=true , address=212.102.52.213:4340 , piece_id=JHX3VX4QX652BPUGAOQOE2ILFO4KX2TWCWOHSPGWF7DSYSFJOQ4Q, seg_pos={0 0}, upload=660090]: Long tail cancellation due to optimal threshold May 25 08:22:33.668431293 (589h33m45.840549723s) [noise=true , address=212.102.52.215:4391 , piece_id=QVDW63WXRWANRT7COCIB42VV6Q4YE6V4OAALKYS7UUDPJLN53HIA, seg_pos={0 0}, upload=660090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jv7h914FvJFDZb7qftHR4eNn5dnzYuJnnCg3hNRAfo6rWVcoc): protocol: expected piece hash; context canceled; EOF May 25 08:22:33.668439799 (589h33m45.840558235s) [noise=true , address=212.102.52.215:4391 , piece_id=QVDW63WXRWANRT7COCIB42VV6Q4YE6V4OAALKYS7UUDPJLN53HIA, seg_pos={0 0}, upload=660090]: Long tail cancellation due to optimal threshold May 25 08:22:33.668674399 (589h33m45.840792827s) [noise=true , address=212.102.52.214:4349 , piece_id=DK6N6HJSYAI3VWKV4VZJTUEYQBH6WK6DRZKWGLWP3PLK2CTDTN2A, seg_pos={0 0}, upload=660090]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12APEgwRugTmZkJ9dXZ71QKCqMZVfYNX7PA8FJFSS5Lx5TGfHpU): protocol: expected piece hash; context canceled; EOF May 25 08:22:33.668684443 (589h33m45.840802873s) [noise=true , address=212.102.52.214:4349 , piece_id=DK6N6HJSYAI3VWKV4VZJTUEYQBH6WK6DRZKWGLWP3PLK2CTDTN2A, seg_pos={0 0}, upload=660090]: Long tail cancellation due to optimal threshold May 25 08:22:33.668711669 (589h33m45.840830089s) [seg_pos={0 0}, upload=660090]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:22:33.668806874 (589h33m45.840925303s) [upload=660090]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:22:33.668812421 (589h33m45.840930844s) [upload=660090]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:23:22.758894005 (589h34m34.931012438s) [upload=660090]: Done uploading segments... May 25 08:23:22.759053082 (589h34m34.931171509s) [upload=660090]: Upload finished. err: metaclient: context deadline exceeded Duration: 1m16.726603776s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.012230325s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:20:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.012335975s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.042635723s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:20:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.042668938s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 1.955425552s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:19:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.955455373s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.011405529s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:19:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.011435659s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 1.943029805s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:18:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.94306294s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 4.037996449s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:17:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.03809112s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 1.992917815s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:16:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.992947817s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 1.973618078s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:15:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.973650052s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 1.999618631s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:14:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.999659554s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 1.942746216s trace: https://jaeger.dev.storj.io/trace/408c9839de13f6d FAIL (2026-05-25 06:14:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.161981579 (586h51m53.334100006s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162030319 (586h51m53.334148748s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162074822 (586h51m53.334193246s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162118965 (586h51m53.33423739s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162168286 (586h51m53.334286713s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162220109 (586h51m53.334338534s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162275962 (586h51m53.334394387s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162335739 (586h51m53.334454164s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162393988 (586h51m53.334512416s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162442100 (586h51m53.334560533s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162483175 (586h51m53.334601605s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162529466 (586h51m53.334647893s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162580672 (586h51m53.3346991s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162628474 (586h51m53.33474691s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162678466 (586h51m53.334796894s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162727195 (586h51m53.334845626s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.162859166 (586h51m53.334977596s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Uploading piece... May 25 05:40:41.656349202 (586h51m53.828467623s) [upload=657063]: Next returned nil segment May 25 05:40:41.656372639 (586h51m53.828491071s) [upload=657063]: Waiting for error group managing segments... May 25 05:40:41.782606782 (586h51m53.954725205s) [noise=true , address=212.102.52.215:4369 , piece_id=XU7BDHLXUVT2NO7KZGADZAYADSX7YEAUSHWO7KDKLVRFJLFFZ5BQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.784037200 (586h51m53.956155625s) [noise=true , address=212.102.52.217:4432 , piece_id=NFI2SCFGKK4ANDLU5HDWT4PTMVGFCR6RANXINWQIPLXR7Q4TBEJQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.786953974 (586h51m53.959072393s) [noise=true , address=212.102.52.217:4417 , piece_id=IDFWHWACGXLNMBDATCKDS5DTCEJ5JYJIFPUKWWRH5HKUCAR4MHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788332003 (586h51m53.960450425s) [noise=true , address=212.102.52.215:4387 , piece_id=2Z3LSB6V5ITR4QGEVUE3AKTWQOLYDRVZTUQF3HOKQSQRWE5BTRLQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.788708596 (586h51m53.960827018s) [noise=true , address=212.102.52.216:4405 , piece_id=CSX4IUBUMM2S6ZXJRD5Y2O3FERZHZVFBRKR3TDI7NGFJCQ5CDOOQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.789824337 (586h51m53.961942757s) [noise=true , address=212.102.52.217:4421 , piece_id=CYOTAQSBFCFKYQ4PW7QIK5HBB2GGVW74IFYMLDWLIU3QUA3QIAHQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.792458606 (586h51m53.964577017s) [noise=true , address=212.102.52.216:4409 , piece_id=64QMCHEYDTNMEDIBWKIBLMWOWVZKK2YG2ITEHZSPTTWM5E2GVN5A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.797279804 (586h51m53.969398233s) [noise=true , address=212.102.52.217:4435 , piece_id=K6ELGN2JQF6LO5GOIVAP63FDIIZTBTC2UREVGSA7X5TCUXDQGTUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798186128 (586h51m53.970304558s) [noise=true , address=212.102.52.216:4407 , piece_id=JOQ6P3YKJPHVACBE3E77T6CSLWQ4LOAWHJDUJ4FL4XP7JCOKXTFA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.798939129 (586h51m53.971057558s) [noise=true , address=212.102.52.213:4344 , piece_id=3FCEPMNW4CG6ZZWJE2DCVLE6MGD4PY4YEZLZHIU6QZUGQ5ZVLI6A, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.799489619 (586h51m53.971620725s) [noise=true , address=212.102.52.216:4394 , piece_id=KU2SGCKX6RKZYTQOSU4CNR374ITNQL5RQGT3D7H7ML2XPEICNM2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800147651 (586h51m53.972266081s) [noise=true , address=212.102.52.215:4376 , piece_id=I5YAEUOQPM5K6G6U22Y2GGAC6K65CN6VPKTMTX57XOB3KMF4HSRA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.800352076 (586h51m53.972470503s) [noise=true , address=212.102.52.213:4333 , piece_id=JZ7APFJJ75HBY76WSP7O6XOMH4PVPRY4TX4YYYNGC7DULQ2PTVKQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.801835683 (586h51m53.973954132s) [noise=true , address=212.102.52.214:4357 , piece_id=5TN4U32X62WPUXLXVAKWIOK3EVAGF5Z3ET35IVYGDIAAGVSQJ6TQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.803871382 (586h51m53.975989812s) [noise=true , address=212.102.52.215:4373 , piece_id=BRDEYFRCMDNTZA2FLJTT6KPNGZZTHUNS7VDFVL4C2GSAIV2NFJUA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806230293 (586h51m53.978348718s) [noise=true , address=212.102.52.214:4346 , piece_id=K6BF2OJ7KVFI6EZQP75QB5ZSJQOEDECBCBNEWNQCKRDOAMOZ3TWQ, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.806295873 (586h51m53.978414297s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 16 pieces May 25 05:40:41.806598426 (586h51m53.978716858s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KpBxYy6FYjFmmajXuNxyyCzLcZuqkLpxvymieKb3hFWW4tTHs): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.806608162 (586h51m53.978726589s) [noise=true , address=212.102.52.214:4355 , piece_id=SKIIEHZLAJHHMPS72D2IIEI4SSJOP6LXCBCLYLVA6RV2Z3LEFF4Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.807554804 (586h51m53.97967323s) [noise=true , address=212.102.52.213:4341 , piece_id=JAFBXKCRQVTHKGFCU5ONUL5DXILH4XVWO5OJ62QGPRNL5XJMVHYA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.807578124 (586h51m53.979696551s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 17 pieces May 25 05:40:41.807844764 (586h51m53.979963197s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cwAu1rBbxVBvbgfqzFyWSjF8t6Si8Z32BLiHuVzvkAGbLb7TR): protocol: expected piece hash; context canceled; EOF May 25 05:40:41.807853233 (586h51m53.979971657s) [noise=true , address=212.102.52.214:4362 , piece_id=BMRNQPIUM4QFPABAGWL3GKYLQGLY6Z3I2OLILHIMLYZQYCVS7S2Q, seg_pos={0 0}, upload=657063]: Long tail cancellation due to optimal threshold May 25 05:40:41.808109294 (586h51m53.980227828s) [noise=true , address=212.102.52.213:4331 , piece_id=6G4BDEULMR6SRGZS4MOPLMUNHSNQIIHKYSFMR6GXSNONR5VJNUSA, seg_pos={0 0}, upload=657063]: Done uploading piece. err: <nil> May 25 05:40:41.808133123 (586h51m53.980251555s) [seg_pos={0 0}, upload=657063]: Satisfied cohort requirements after 18 pieces May 25 05:40:41.808174558 (586h51m53.980292969s) [seg_pos={0 0}, upload=657063]: Done waiting for segment. successful: 18 optimal: 16 errs: <nil> May 25 05:40:41.808385638 (586h51m53.980504064s) [upload=657063]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 05:40:41.808394448 (586h51m53.98051287s) [upload=657063]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 05:41:02.691159266 (586h52m14.863277679s) [upload=657063]: Done uploading segments... May 25 05:41:02.691281386 (586h52m14.863399818s) [upload=657063]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.9427824s core uplink uk-select-1 uk1-placement-17

Orbiter Check History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)