Orbiter History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.001772459s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:55:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.001800275s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.262485748s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:55:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.262517988s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [X................X..........................................] duration: 1.990658244s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:54:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.990687215s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.X................X.........................................] duration: 2.007529756s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:53:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.007559951s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..X................X........................................] duration: 2.239963125s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:53:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.239992784s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...X................X.......................................] duration: 2.020783037s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:52:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.020815482s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [....X................X......................................] duration: 2.10595852s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:52:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.105985641s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.....X................X.....................................] duration: 2.09741261s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:51:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.097444989s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [......X................X....................................] duration: 2.071964919s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:51:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.07207914s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.......X................X...................................] duration: 2.123544065s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:50:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.123578845s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [........X................X..................................] duration: 2.388285207s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:49:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.388318635s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.........X................X.................................] duration: 1.888306464s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:48:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.888336128s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..........X................X................................] duration: 1.982056454s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:48:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.982243625s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...........X................X...............................] duration: 2.186752602s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:47:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.186780288s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [............X................X..............................] duration: 1.921705442s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:46:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.921735713s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.............X................X.............................] duration: 2.150960249s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:45:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.150992485s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..............X................X............................] duration: 2.819638455s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:44:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.819727965s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...............X................X...........................] duration: 2.309867651s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:43:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.309896646s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [................X................X..........................] duration: 1.975987054s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:42:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.97630538s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.................X................X.........................] duration: 2.281669139s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:41:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.281700455s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..................X................X........................] duration: 1.910089509s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:41:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.910156983s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...................X................X.......................] duration: 2.80216417s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:40:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.802188788s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [....................X................X......................] duration: 2.03071701s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:39:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.030745791s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.....................X................X.....................] duration: 2.23171243s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:38:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.231751116s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [......................X................X....................] duration: 2.309268805s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:37:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.309299475s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.......................X................X...................] duration: 5.439184531s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:36:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.43920962s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [........................X................X..................] duration: 10.07865523s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:36:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 10.078687536s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.........................X................X.................] duration: 1.968036732s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:35:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.968070291s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..........................X................X................] duration: 2.040794512s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:35:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.040844812s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...........................X................X...............] duration: 5.327810895s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:34:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.327845435s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [............................X................X..............] duration: 3.000529205s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:34:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.00055387s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.............................X................X.............] duration: 2.015668748s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:33:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.01569969s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..............................X................X............] duration: 1.970292453s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:31:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.970321124s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...............................X................X...........] duration: 2.550119385s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:30:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.550154416s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [................................X................X..........] duration: 1.994393108s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:29:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.99447713s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.................................X................X.........] duration: 1.902369988s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:28:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.902474806s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..................................X................X........] duration: 4.114294145s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:28:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.114325616s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...................................X................X.......] duration: 2.237985361s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:27:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.23801655s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [....................................X................X......] duration: 2.12816035s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:27:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.128225452s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X................X.....] duration: 54.613065731s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:26:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 54.613093846s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [......................................X................X....] duration: 2.396936995s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:24:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.396964452s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X................X...] duration: 1.953405415s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:24:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.953438999s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [........................................X................X..] duration: 49.998587722s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:24:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 49.998628036s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X................X.] duration: 1.968355527s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:22:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.968373415s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X................X] duration: 1m43.680242258s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:22:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 1m43.680329004s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.056552057s trace: https://jaeger.dev.storj.io/trace/61b819dd76ca3968 FAIL (2026-05-25 09:19:40 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== d=660950]: Uploading piece... May 25 09:08:10.059238343 (590h19m22.231356762s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059354538 (590h19m22.231472968s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059771499 (590h19m22.231889918s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059807053 (590h19m22.231925483s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060275645 (590h19m22.232394075s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060307510 (590h19m22.232425946s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.062905295 (590h19m22.235023715s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.064443872 (590h19m22.236562302s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065651209 (590h19m22.23776963s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065970059 (590h19m22.238088482s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.066174389 (590h19m22.238292802s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.067629392 (590h19m22.239747819s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.068738743 (590h19m22.240857171s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.069571471 (590h19m22.241689901s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.070929017 (590h19m22.243047531s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.071635650 (590h19m22.243754069s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.545033315 (590h19m22.717151725s) [upload=660950]: Next returned nil segment May 25 09:08:10.545048288 (590h19m22.717166698s) [upload=660950]: Waiting for error group managing segments... May 25 09:08:10.656961313 (590h19m22.829079748s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.660492629 (590h19m22.832611053s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.662607276 (590h19m22.834725685s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.666191427 (590h19m22.838309847s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.668082986 (590h19m22.840201397s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.669200102 (590h19m22.841318528s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.674586437 (590h19m22.846704856s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.678894173 (590h19m22.851012593s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679139984 (590h19m22.851258406s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679968043 (590h19m22.852086452s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680106523 (590h19m22.852224947s) [noise=true , address=212.102.52.217:4436 , piece_id=JBR5XJONLHCAETPKBSYIU3Y7I4JFALL2HIFJOMNDOASEWO7P42DQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680935682 (590h19m22.853054103s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.681682946 (590h19m22.853801352s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.686246172 (590h19m22.858364583s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.688393735 (590h19m22.860512145s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690400315 (590h19m22.862518735s) [noise=true , address=212.102.52.217:4440 , piece_id=N3LLXGOYVOLW6LPZJ5PFIPHCNTB4IBPE63EJNGSTRNA7DMMY25AQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690424503 (590h19m22.862542927s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 16 pieces May 25 09:08:10.690668447 (590h19m22.862786875s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.690679709 (590h19m22.862798133s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691127046 (590h19m22.863245472s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iSvBnTTWbzuUHvn6sGakZnV9o8XQ9GTtfA3hL6yupvHaW95Rp): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691136272 (590h19m22.86325469s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691302431 (590h19m22.863420862s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qc5vbvWmHz46Ahoqq32hrEXj5bkFxp7ozxghyu9WN5mwtTSJA): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691312534 (590h19m22.863430965s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691851002 (590h19m22.863969422s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.691894332 (590h19m22.864012753s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 17 pieces May 25 09:08:10.691920976 (590h19m22.864039381s) [seg_pos={0 0}, upload=660950]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:08:10.692199274 (590h19m22.864317694s) [upload=660950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:08:10.692208482 (590h19m22.864326904s) [upload=660950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:08:21.511488298 (590h19m33.683606726s) [upload=660950]: Done uploading segments... May 25 09:08:21.511515102 (590h19m33.683633534s) [upload=660950]: Upload finished. err: <nil> Duration: 2.056649732s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.035087093s trace: https://jaeger.dev.storj.io/trace/61b819dd76ca3968 FAIL (2026-05-25 09:18:31 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== d=660950]: Uploading piece... May 25 09:08:10.059238343 (590h19m22.231356762s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059354538 (590h19m22.231472968s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059771499 (590h19m22.231889918s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059807053 (590h19m22.231925483s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060275645 (590h19m22.232394075s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060307510 (590h19m22.232425946s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.062905295 (590h19m22.235023715s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.064443872 (590h19m22.236562302s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065651209 (590h19m22.23776963s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065970059 (590h19m22.238088482s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.066174389 (590h19m22.238292802s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.067629392 (590h19m22.239747819s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.068738743 (590h19m22.240857171s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.069571471 (590h19m22.241689901s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.070929017 (590h19m22.243047531s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.071635650 (590h19m22.243754069s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.545033315 (590h19m22.717151725s) [upload=660950]: Next returned nil segment May 25 09:08:10.545048288 (590h19m22.717166698s) [upload=660950]: Waiting for error group managing segments... May 25 09:08:10.656961313 (590h19m22.829079748s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.660492629 (590h19m22.832611053s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.662607276 (590h19m22.834725685s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.666191427 (590h19m22.838309847s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.668082986 (590h19m22.840201397s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.669200102 (590h19m22.841318528s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.674586437 (590h19m22.846704856s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.678894173 (590h19m22.851012593s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679139984 (590h19m22.851258406s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679968043 (590h19m22.852086452s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680106523 (590h19m22.852224947s) [noise=true , address=212.102.52.217:4436 , piece_id=JBR5XJONLHCAETPKBSYIU3Y7I4JFALL2HIFJOMNDOASEWO7P42DQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680935682 (590h19m22.853054103s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.681682946 (590h19m22.853801352s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.686246172 (590h19m22.858364583s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.688393735 (590h19m22.860512145s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690400315 (590h19m22.862518735s) [noise=true , address=212.102.52.217:4440 , piece_id=N3LLXGOYVOLW6LPZJ5PFIPHCNTB4IBPE63EJNGSTRNA7DMMY25AQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690424503 (590h19m22.862542927s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 16 pieces May 25 09:08:10.690668447 (590h19m22.862786875s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.690679709 (590h19m22.862798133s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691127046 (590h19m22.863245472s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iSvBnTTWbzuUHvn6sGakZnV9o8XQ9GTtfA3hL6yupvHaW95Rp): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691136272 (590h19m22.86325469s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691302431 (590h19m22.863420862s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qc5vbvWmHz46Ahoqq32hrEXj5bkFxp7ozxghyu9WN5mwtTSJA): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691312534 (590h19m22.863430965s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691851002 (590h19m22.863969422s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.691894332 (590h19m22.864012753s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 17 pieces May 25 09:08:10.691920976 (590h19m22.864039381s) [seg_pos={0 0}, upload=660950]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:08:10.692199274 (590h19m22.864317694s) [upload=660950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:08:10.692208482 (590h19m22.864326904s) [upload=660950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:08:21.511488298 (590h19m33.683606726s) [upload=660950]: Done uploading segments... May 25 09:08:21.511515102 (590h19m33.683633534s) [upload=660950]: Upload finished. err: <nil> Duration: 2.035220331s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.286045982s trace: https://jaeger.dev.storj.io/trace/61b819dd76ca3968 FAIL (2026-05-25 09:18:03 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== d=660950]: Uploading piece... May 25 09:08:10.059238343 (590h19m22.231356762s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059354538 (590h19m22.231472968s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059771499 (590h19m22.231889918s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059807053 (590h19m22.231925483s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060275645 (590h19m22.232394075s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060307510 (590h19m22.232425946s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.062905295 (590h19m22.235023715s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.064443872 (590h19m22.236562302s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065651209 (590h19m22.23776963s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065970059 (590h19m22.238088482s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.066174389 (590h19m22.238292802s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.067629392 (590h19m22.239747819s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.068738743 (590h19m22.240857171s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.069571471 (590h19m22.241689901s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.070929017 (590h19m22.243047531s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.071635650 (590h19m22.243754069s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.545033315 (590h19m22.717151725s) [upload=660950]: Next returned nil segment May 25 09:08:10.545048288 (590h19m22.717166698s) [upload=660950]: Waiting for error group managing segments... May 25 09:08:10.656961313 (590h19m22.829079748s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.660492629 (590h19m22.832611053s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.662607276 (590h19m22.834725685s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.666191427 (590h19m22.838309847s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.668082986 (590h19m22.840201397s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.669200102 (590h19m22.841318528s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.674586437 (590h19m22.846704856s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.678894173 (590h19m22.851012593s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679139984 (590h19m22.851258406s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679968043 (590h19m22.852086452s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680106523 (590h19m22.852224947s) [noise=true , address=212.102.52.217:4436 , piece_id=JBR5XJONLHCAETPKBSYIU3Y7I4JFALL2HIFJOMNDOASEWO7P42DQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680935682 (590h19m22.853054103s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.681682946 (590h19m22.853801352s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.686246172 (590h19m22.858364583s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.688393735 (590h19m22.860512145s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690400315 (590h19m22.862518735s) [noise=true , address=212.102.52.217:4440 , piece_id=N3LLXGOYVOLW6LPZJ5PFIPHCNTB4IBPE63EJNGSTRNA7DMMY25AQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690424503 (590h19m22.862542927s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 16 pieces May 25 09:08:10.690668447 (590h19m22.862786875s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.690679709 (590h19m22.862798133s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691127046 (590h19m22.863245472s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iSvBnTTWbzuUHvn6sGakZnV9o8XQ9GTtfA3hL6yupvHaW95Rp): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691136272 (590h19m22.86325469s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691302431 (590h19m22.863420862s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qc5vbvWmHz46Ahoqq32hrEXj5bkFxp7ozxghyu9WN5mwtTSJA): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691312534 (590h19m22.863430965s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691851002 (590h19m22.863969422s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.691894332 (590h19m22.864012753s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 17 pieces May 25 09:08:10.691920976 (590h19m22.864039381s) [seg_pos={0 0}, upload=660950]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:08:10.692199274 (590h19m22.864317694s) [upload=660950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:08:10.692208482 (590h19m22.864326904s) [upload=660950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:08:21.511488298 (590h19m33.683606726s) [upload=660950]: Done uploading segments... May 25 09:08:21.511515102 (590h19m33.683633534s) [upload=660950]: Upload finished. err: <nil> Duration: 2.286085448s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.102358432s trace: https://jaeger.dev.storj.io/trace/61b819dd76ca3968 FAIL (2026-05-25 09:17:32 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== d=660950]: Uploading piece... May 25 09:08:10.059238343 (590h19m22.231356762s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059354538 (590h19m22.231472968s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059771499 (590h19m22.231889918s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059807053 (590h19m22.231925483s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060275645 (590h19m22.232394075s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060307510 (590h19m22.232425946s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.062905295 (590h19m22.235023715s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.064443872 (590h19m22.236562302s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065651209 (590h19m22.23776963s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065970059 (590h19m22.238088482s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.066174389 (590h19m22.238292802s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.067629392 (590h19m22.239747819s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.068738743 (590h19m22.240857171s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.069571471 (590h19m22.241689901s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.070929017 (590h19m22.243047531s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.071635650 (590h19m22.243754069s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.545033315 (590h19m22.717151725s) [upload=660950]: Next returned nil segment May 25 09:08:10.545048288 (590h19m22.717166698s) [upload=660950]: Waiting for error group managing segments... May 25 09:08:10.656961313 (590h19m22.829079748s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.660492629 (590h19m22.832611053s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.662607276 (590h19m22.834725685s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.666191427 (590h19m22.838309847s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.668082986 (590h19m22.840201397s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.669200102 (590h19m22.841318528s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.674586437 (590h19m22.846704856s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.678894173 (590h19m22.851012593s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679139984 (590h19m22.851258406s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679968043 (590h19m22.852086452s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680106523 (590h19m22.852224947s) [noise=true , address=212.102.52.217:4436 , piece_id=JBR5XJONLHCAETPKBSYIU3Y7I4JFALL2HIFJOMNDOASEWO7P42DQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680935682 (590h19m22.853054103s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.681682946 (590h19m22.853801352s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.686246172 (590h19m22.858364583s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.688393735 (590h19m22.860512145s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690400315 (590h19m22.862518735s) [noise=true , address=212.102.52.217:4440 , piece_id=N3LLXGOYVOLW6LPZJ5PFIPHCNTB4IBPE63EJNGSTRNA7DMMY25AQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690424503 (590h19m22.862542927s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 16 pieces May 25 09:08:10.690668447 (590h19m22.862786875s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.690679709 (590h19m22.862798133s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691127046 (590h19m22.863245472s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iSvBnTTWbzuUHvn6sGakZnV9o8XQ9GTtfA3hL6yupvHaW95Rp): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691136272 (590h19m22.86325469s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691302431 (590h19m22.863420862s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qc5vbvWmHz46Ahoqq32hrEXj5bkFxp7ozxghyu9WN5mwtTSJA): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691312534 (590h19m22.863430965s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691851002 (590h19m22.863969422s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.691894332 (590h19m22.864012753s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 17 pieces May 25 09:08:10.691920976 (590h19m22.864039381s) [seg_pos={0 0}, upload=660950]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:08:10.692199274 (590h19m22.864317694s) [upload=660950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:08:10.692208482 (590h19m22.864326904s) [upload=660950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:08:21.511488298 (590h19m33.683606726s) [upload=660950]: Done uploading segments... May 25 09:08:21.511515102 (590h19m33.683633534s) [upload=660950]: Upload finished. err: <nil> Duration: 2.102388575s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.079629369s trace: https://jaeger.dev.storj.io/trace/61b819dd76ca3968 FAIL (2026-05-25 09:16:22 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== d=660950]: Uploading piece... May 25 09:08:10.059238343 (590h19m22.231356762s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059354538 (590h19m22.231472968s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059771499 (590h19m22.231889918s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059807053 (590h19m22.231925483s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060275645 (590h19m22.232394075s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060307510 (590h19m22.232425946s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.062905295 (590h19m22.235023715s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.064443872 (590h19m22.236562302s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065651209 (590h19m22.23776963s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065970059 (590h19m22.238088482s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.066174389 (590h19m22.238292802s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.067629392 (590h19m22.239747819s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.068738743 (590h19m22.240857171s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.069571471 (590h19m22.241689901s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.070929017 (590h19m22.243047531s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.071635650 (590h19m22.243754069s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.545033315 (590h19m22.717151725s) [upload=660950]: Next returned nil segment May 25 09:08:10.545048288 (590h19m22.717166698s) [upload=660950]: Waiting for error group managing segments... May 25 09:08:10.656961313 (590h19m22.829079748s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.660492629 (590h19m22.832611053s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.662607276 (590h19m22.834725685s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.666191427 (590h19m22.838309847s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.668082986 (590h19m22.840201397s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.669200102 (590h19m22.841318528s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.674586437 (590h19m22.846704856s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.678894173 (590h19m22.851012593s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679139984 (590h19m22.851258406s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679968043 (590h19m22.852086452s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680106523 (590h19m22.852224947s) [noise=true , address=212.102.52.217:4436 , piece_id=JBR5XJONLHCAETPKBSYIU3Y7I4JFALL2HIFJOMNDOASEWO7P42DQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680935682 (590h19m22.853054103s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.681682946 (590h19m22.853801352s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.686246172 (590h19m22.858364583s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.688393735 (590h19m22.860512145s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690400315 (590h19m22.862518735s) [noise=true , address=212.102.52.217:4440 , piece_id=N3LLXGOYVOLW6LPZJ5PFIPHCNTB4IBPE63EJNGSTRNA7DMMY25AQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690424503 (590h19m22.862542927s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 16 pieces May 25 09:08:10.690668447 (590h19m22.862786875s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.690679709 (590h19m22.862798133s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691127046 (590h19m22.863245472s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iSvBnTTWbzuUHvn6sGakZnV9o8XQ9GTtfA3hL6yupvHaW95Rp): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691136272 (590h19m22.86325469s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691302431 (590h19m22.863420862s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qc5vbvWmHz46Ahoqq32hrEXj5bkFxp7ozxghyu9WN5mwtTSJA): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691312534 (590h19m22.863430965s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691851002 (590h19m22.863969422s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.691894332 (590h19m22.864012753s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 17 pieces May 25 09:08:10.691920976 (590h19m22.864039381s) [seg_pos={0 0}, upload=660950]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:08:10.692199274 (590h19m22.864317694s) [upload=660950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:08:10.692208482 (590h19m22.864326904s) [upload=660950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:08:21.511488298 (590h19m33.683606726s) [upload=660950]: Done uploading segments... May 25 09:08:21.511515102 (590h19m33.683633534s) [upload=660950]: Upload finished. err: <nil> Duration: 2.079661104s core uplink uk-select-1 uk1-placement-17

Orbiter Check History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)