Orbiter History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...........................X................X...............] duration: 5.327810895s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:34:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 5.327845435s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [............................X................X..............] duration: 3.000529205s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:34:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.00055387s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.............................X................X.............] duration: 2.015668748s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:33:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.01569969s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..............................X................X............] duration: 1.970292453s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:31:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.970321124s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...............................X................X...........] duration: 2.550119385s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:30:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.550154416s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [................................X................X..........] duration: 1.994393108s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:29:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.99447713s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.................................X................X.........] duration: 1.902369988s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:28:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.902474806s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..................................X................X........] duration: 4.114294145s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:28:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 4.114325616s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...................................X................X.......] duration: 2.237985361s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:27:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.23801655s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [....................................X................X......] duration: 2.12816035s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:27:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.128225452s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X................X.....] duration: 54.613065731s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:26:54 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 54.613093846s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [......................................X................X....] duration: 2.396936995s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:24:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.396964452s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X................X...] duration: 1.953405415s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:24:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.953438999s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [........................................X................X..] duration: 49.998587722s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:24:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 49.998628036s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X................X.] duration: 1.968355527s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:22:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.968373415s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X................X] duration: 1m43.680242258s trace: https://jaeger.dev.storj.io/trace/309a34c07c694331 FAIL (2026-05-25 09:22:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== y 25 09:21:22.628886222 (590h32m34.801004651s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629921010 (590h32m34.802039436s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.629986086 (590h32m34.802104519s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.630278183 (590h32m34.802396602s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631423761 (590h32m34.803542186s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.631479157 (590h32m34.803597576s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.632447533 (590h32m34.804565953s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.636186169 (590h32m34.808304592s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.638044351 (590h32m34.81016278s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.639188848 (590h32m34.811307268s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.640011045 (590h32m34.812129469s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641230986 (590h32m34.813349412s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.641599989 (590h32m34.813718402s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.642946639 (590h32m34.815065067s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.643468905 (590h32m34.815587316s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:22.644410250 (590h32m34.816528663s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Uploading piece... May 25 09:21:23.115321993 (590h32m35.28744042s) [upload=661186]: Next returned nil segment May 25 09:21:23.115337832 (590h32m35.287456264s) [upload=661186]: Waiting for error group managing segments... May 25 09:21:23.233489911 (590h32m35.405608333s) [noise=true , address=212.102.52.214:4350 , piece_id=F2XF7A4HLS2ZEUEK3OYVZL5FIJPAL5TKBMYL6ASAPVCLZZWKMBQA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234287863 (590h32m35.406406283s) [noise=true , address=212.102.52.213:4326 , piece_id=5E2NNJE6IVXXGH7YPTILFUA2QSZHKJFHFMSL44XOHQELR2ATL5VQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.234483949 (590h32m35.406602369s) [noise=true , address=212.102.52.214:4362 , piece_id=RXHLCLSBIRS44O4L6KA2OPR53CDGGDDPFJJGQWVSNIEHXLDO6U2Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.235745653 (590h32m35.407864071s) [noise=true , address=212.102.52.215:4372 , piece_id=V7NVYWKXINW3EQXJXFGRDR34BMV6WSE67Q3N6ZTMY6BXAJHB6ZWQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.238115027 (590h32m35.410233448s) [noise=true , address=212.102.52.214:4352 , piece_id=PIJSNEKZHASORHIS3BSITTGASJWIWXLI7JTNWEWRRPWFCOBNTG5Q, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.244951402 (590h32m35.417069825s) [noise=true , address=212.102.52.216:4397 , piece_id=MSAKBONSRVB246XTM3FOK3DB4ZMH3PB5HSUCK47JTXL2BSHYF3TQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246070872 (590h32m35.418189292s) [noise=true , address=212.102.52.214:4349 , piece_id=SMOSBB6VWUXXDJTS26AM2LD45INVRX5LXOGKR5FURHJQVU7DAG5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.246902189 (590h32m35.419020618s) [noise=true , address=212.102.52.217:4423 , piece_id=3Q4XWDBGUV5QC36WY3O3HNPIVJKHAMJOZRFRLJUZ4HYW3CQ2ZW4A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248720945 (590h32m35.420839364s) [noise=true , address=212.102.52.216:4398 , piece_id=77PND6ZAUN3UCGISYE52ZUMBDDXXCDB3NGTQYUZP4CPU4QR5GBBA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.248925863 (590h32m35.421044283s) [noise=true , address=212.102.52.213:4325 , piece_id=NROXQZKNACZRMDBKHDKYIKBUYWWJUEFRN5ZMGPRSXM44DYGKIRCQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.251143146 (590h32m35.423261569s) [noise=true , address=212.102.52.216:4416 , piece_id=XK5YXNY42BULO2OMB5AYVAGM4KFFOBIBSYNPCSKPYXJ62A2SMV5A, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254239820 (590h32m35.426358241s) [noise=true , address=212.102.52.217:4432 , piece_id=IYGGFAPJ6NESWVWH7DQ2TH3E3WXERSSRNZWMQ7YRIBX7XRCGX4OQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.254610475 (590h32m35.426728896s) [noise=true , address=212.102.52.213:4341 , piece_id=Q3NNR6KFJ7ZHLEWT7342PNNYBH3EC7HZ7KIBL4FNIAC6RCS4CMSQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257216497 (590h32m35.429334925s) [noise=true , address=212.102.52.213:4329 , piece_id=UF7DSAHQ7PDQ4BEDC4KD2WIUMSBKK4LSOTBROI6D2AWO47NPK6EQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.257932349 (590h32m35.430050768s) [noise=true , address=212.102.52.215:4392 , piece_id=E7VRS3HFHPKGX5MFFGKHW3DZU6MYVGYQ6BGOEV2IHRGL2VJMBXXQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261328760 (590h32m35.433447191s) [noise=true , address=212.102.52.215:4370 , piece_id=NVVBHHVOMKFCOB3P5P4RHTYYXGHH5TJDQUJ3HY2SS6CC4HUMFIAA, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261368485 (590h32m35.433486915s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 16 pieces May 25 09:21:23.261653901 (590h32m35.433772321s) [noise=true , address=212.102.52.217:4429 , piece_id=HA6ZT7HHH4XSDBGQN4VIKBZA6IUJJ5C5MVJEDMMYNWTEJH7BNXGQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: <nil> May 25 09:21:23.261673172 (590h32m35.433791601s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZdAeNhTrFvVQJopWnWFXMy3faBXCK6GvBxEMcG2MzhKNiX6LP): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.261686406 (590h32m35.433804838s) [noise=true , address=212.102.52.217:4435 , piece_id=2BW6XRQSIXQQUQ6RUTYKXTBCWBZ7H2FSYAHPSGGV2MMLI6IT7ZAQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.261700804 (590h32m35.433819217s) [seg_pos={0 0}, upload=661186]: Satisfied cohort requirements after 17 pieces May 25 09:21:23.262134465 (590h32m35.434252955s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1duCdMX8qKPn5rMrjxvin5jdjRXRLAQcGJQWwxiTQ8caKXrVtg): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262146887 (590h32m35.434265354s) [noise=true , address=212.102.52.215:4381 , piece_id=ENHKMHISXPAEK2C5UAE2DS6S727GY4ELSJ2QLVYM6IERSITVIYTQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262167837 (590h32m35.434286243s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 09:21:23.262176272 (590h32m35.434294696s) [noise=true , address=212.102.52.216:4403 , piece_id=TRFOGVDXMFXXGJ5PF4ZYQ73CHS54QYHYVVJHWMZHKWSRJN2IBZOQ, seg_pos={0 0}, upload=661186]: Long tail cancellation due to optimal threshold May 25 09:21:23.262209217 (590h32m35.434327637s) [seg_pos={0 0}, upload=661186]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:21:23.262318324 (590h32m35.434436756s) [upload=661186]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:21:23.262325380 (590h32m35.434443808s) [upload=661186]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:22:23.497271323 (590h33m35.669389744s) [upload=661186]: Done uploading segments... May 25 09:22:23.497381555 (590h33m35.669499984s) [upload=661186]: Upload finished. err: metaclient: context deadline exceeded Duration: 1m43.680329004s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.056552057s trace: https://jaeger.dev.storj.io/trace/61b819dd76ca3968 FAIL (2026-05-25 09:19:40 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== d=660950]: Uploading piece... May 25 09:08:10.059238343 (590h19m22.231356762s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059354538 (590h19m22.231472968s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059771499 (590h19m22.231889918s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059807053 (590h19m22.231925483s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060275645 (590h19m22.232394075s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060307510 (590h19m22.232425946s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.062905295 (590h19m22.235023715s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.064443872 (590h19m22.236562302s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065651209 (590h19m22.23776963s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065970059 (590h19m22.238088482s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.066174389 (590h19m22.238292802s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.067629392 (590h19m22.239747819s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.068738743 (590h19m22.240857171s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.069571471 (590h19m22.241689901s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.070929017 (590h19m22.243047531s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.071635650 (590h19m22.243754069s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.545033315 (590h19m22.717151725s) [upload=660950]: Next returned nil segment May 25 09:08:10.545048288 (590h19m22.717166698s) [upload=660950]: Waiting for error group managing segments... May 25 09:08:10.656961313 (590h19m22.829079748s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.660492629 (590h19m22.832611053s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.662607276 (590h19m22.834725685s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.666191427 (590h19m22.838309847s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.668082986 (590h19m22.840201397s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.669200102 (590h19m22.841318528s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.674586437 (590h19m22.846704856s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.678894173 (590h19m22.851012593s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679139984 (590h19m22.851258406s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679968043 (590h19m22.852086452s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680106523 (590h19m22.852224947s) [noise=true , address=212.102.52.217:4436 , piece_id=JBR5XJONLHCAETPKBSYIU3Y7I4JFALL2HIFJOMNDOASEWO7P42DQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680935682 (590h19m22.853054103s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.681682946 (590h19m22.853801352s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.686246172 (590h19m22.858364583s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.688393735 (590h19m22.860512145s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690400315 (590h19m22.862518735s) [noise=true , address=212.102.52.217:4440 , piece_id=N3LLXGOYVOLW6LPZJ5PFIPHCNTB4IBPE63EJNGSTRNA7DMMY25AQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690424503 (590h19m22.862542927s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 16 pieces May 25 09:08:10.690668447 (590h19m22.862786875s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.690679709 (590h19m22.862798133s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691127046 (590h19m22.863245472s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iSvBnTTWbzuUHvn6sGakZnV9o8XQ9GTtfA3hL6yupvHaW95Rp): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691136272 (590h19m22.86325469s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691302431 (590h19m22.863420862s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qc5vbvWmHz46Ahoqq32hrEXj5bkFxp7ozxghyu9WN5mwtTSJA): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691312534 (590h19m22.863430965s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691851002 (590h19m22.863969422s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.691894332 (590h19m22.864012753s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 17 pieces May 25 09:08:10.691920976 (590h19m22.864039381s) [seg_pos={0 0}, upload=660950]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:08:10.692199274 (590h19m22.864317694s) [upload=660950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:08:10.692208482 (590h19m22.864326904s) [upload=660950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:08:21.511488298 (590h19m33.683606726s) [upload=660950]: Done uploading segments... May 25 09:08:21.511515102 (590h19m33.683633534s) [upload=660950]: Upload finished. err: <nil> Duration: 2.056649732s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.035087093s trace: https://jaeger.dev.storj.io/trace/61b819dd76ca3968 FAIL (2026-05-25 09:18:31 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== d=660950]: Uploading piece... May 25 09:08:10.059238343 (590h19m22.231356762s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059354538 (590h19m22.231472968s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059771499 (590h19m22.231889918s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059807053 (590h19m22.231925483s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060275645 (590h19m22.232394075s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060307510 (590h19m22.232425946s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.062905295 (590h19m22.235023715s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.064443872 (590h19m22.236562302s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065651209 (590h19m22.23776963s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065970059 (590h19m22.238088482s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.066174389 (590h19m22.238292802s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.067629392 (590h19m22.239747819s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.068738743 (590h19m22.240857171s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.069571471 (590h19m22.241689901s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.070929017 (590h19m22.243047531s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.071635650 (590h19m22.243754069s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.545033315 (590h19m22.717151725s) [upload=660950]: Next returned nil segment May 25 09:08:10.545048288 (590h19m22.717166698s) [upload=660950]: Waiting for error group managing segments... May 25 09:08:10.656961313 (590h19m22.829079748s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.660492629 (590h19m22.832611053s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.662607276 (590h19m22.834725685s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.666191427 (590h19m22.838309847s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.668082986 (590h19m22.840201397s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.669200102 (590h19m22.841318528s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.674586437 (590h19m22.846704856s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.678894173 (590h19m22.851012593s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679139984 (590h19m22.851258406s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679968043 (590h19m22.852086452s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680106523 (590h19m22.852224947s) [noise=true , address=212.102.52.217:4436 , piece_id=JBR5XJONLHCAETPKBSYIU3Y7I4JFALL2HIFJOMNDOASEWO7P42DQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680935682 (590h19m22.853054103s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.681682946 (590h19m22.853801352s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.686246172 (590h19m22.858364583s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.688393735 (590h19m22.860512145s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690400315 (590h19m22.862518735s) [noise=true , address=212.102.52.217:4440 , piece_id=N3LLXGOYVOLW6LPZJ5PFIPHCNTB4IBPE63EJNGSTRNA7DMMY25AQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690424503 (590h19m22.862542927s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 16 pieces May 25 09:08:10.690668447 (590h19m22.862786875s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.690679709 (590h19m22.862798133s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691127046 (590h19m22.863245472s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iSvBnTTWbzuUHvn6sGakZnV9o8XQ9GTtfA3hL6yupvHaW95Rp): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691136272 (590h19m22.86325469s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691302431 (590h19m22.863420862s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qc5vbvWmHz46Ahoqq32hrEXj5bkFxp7ozxghyu9WN5mwtTSJA): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691312534 (590h19m22.863430965s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691851002 (590h19m22.863969422s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.691894332 (590h19m22.864012753s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 17 pieces May 25 09:08:10.691920976 (590h19m22.864039381s) [seg_pos={0 0}, upload=660950]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:08:10.692199274 (590h19m22.864317694s) [upload=660950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:08:10.692208482 (590h19m22.864326904s) [upload=660950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:08:21.511488298 (590h19m33.683606726s) [upload=660950]: Done uploading segments... May 25 09:08:21.511515102 (590h19m33.683633534s) [upload=660950]: Upload finished. err: <nil> Duration: 2.035220331s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.286045982s trace: https://jaeger.dev.storj.io/trace/61b819dd76ca3968 FAIL (2026-05-25 09:18:03 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== d=660950]: Uploading piece... May 25 09:08:10.059238343 (590h19m22.231356762s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059354538 (590h19m22.231472968s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059771499 (590h19m22.231889918s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059807053 (590h19m22.231925483s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060275645 (590h19m22.232394075s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060307510 (590h19m22.232425946s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.062905295 (590h19m22.235023715s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.064443872 (590h19m22.236562302s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065651209 (590h19m22.23776963s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065970059 (590h19m22.238088482s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.066174389 (590h19m22.238292802s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.067629392 (590h19m22.239747819s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.068738743 (590h19m22.240857171s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.069571471 (590h19m22.241689901s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.070929017 (590h19m22.243047531s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.071635650 (590h19m22.243754069s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.545033315 (590h19m22.717151725s) [upload=660950]: Next returned nil segment May 25 09:08:10.545048288 (590h19m22.717166698s) [upload=660950]: Waiting for error group managing segments... May 25 09:08:10.656961313 (590h19m22.829079748s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.660492629 (590h19m22.832611053s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.662607276 (590h19m22.834725685s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.666191427 (590h19m22.838309847s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.668082986 (590h19m22.840201397s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.669200102 (590h19m22.841318528s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.674586437 (590h19m22.846704856s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.678894173 (590h19m22.851012593s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679139984 (590h19m22.851258406s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679968043 (590h19m22.852086452s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680106523 (590h19m22.852224947s) [noise=true , address=212.102.52.217:4436 , piece_id=JBR5XJONLHCAETPKBSYIU3Y7I4JFALL2HIFJOMNDOASEWO7P42DQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680935682 (590h19m22.853054103s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.681682946 (590h19m22.853801352s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.686246172 (590h19m22.858364583s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.688393735 (590h19m22.860512145s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690400315 (590h19m22.862518735s) [noise=true , address=212.102.52.217:4440 , piece_id=N3LLXGOYVOLW6LPZJ5PFIPHCNTB4IBPE63EJNGSTRNA7DMMY25AQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690424503 (590h19m22.862542927s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 16 pieces May 25 09:08:10.690668447 (590h19m22.862786875s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.690679709 (590h19m22.862798133s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691127046 (590h19m22.863245472s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iSvBnTTWbzuUHvn6sGakZnV9o8XQ9GTtfA3hL6yupvHaW95Rp): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691136272 (590h19m22.86325469s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691302431 (590h19m22.863420862s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qc5vbvWmHz46Ahoqq32hrEXj5bkFxp7ozxghyu9WN5mwtTSJA): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691312534 (590h19m22.863430965s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691851002 (590h19m22.863969422s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.691894332 (590h19m22.864012753s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 17 pieces May 25 09:08:10.691920976 (590h19m22.864039381s) [seg_pos={0 0}, upload=660950]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:08:10.692199274 (590h19m22.864317694s) [upload=660950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:08:10.692208482 (590h19m22.864326904s) [upload=660950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:08:21.511488298 (590h19m33.683606726s) [upload=660950]: Done uploading segments... May 25 09:08:21.511515102 (590h19m33.683633534s) [upload=660950]: Upload finished. err: <nil> Duration: 2.286085448s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.102358432s trace: https://jaeger.dev.storj.io/trace/61b819dd76ca3968 FAIL (2026-05-25 09:17:32 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== d=660950]: Uploading piece... May 25 09:08:10.059238343 (590h19m22.231356762s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059354538 (590h19m22.231472968s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059771499 (590h19m22.231889918s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059807053 (590h19m22.231925483s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060275645 (590h19m22.232394075s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060307510 (590h19m22.232425946s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.062905295 (590h19m22.235023715s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.064443872 (590h19m22.236562302s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065651209 (590h19m22.23776963s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065970059 (590h19m22.238088482s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.066174389 (590h19m22.238292802s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.067629392 (590h19m22.239747819s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.068738743 (590h19m22.240857171s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.069571471 (590h19m22.241689901s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.070929017 (590h19m22.243047531s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.071635650 (590h19m22.243754069s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.545033315 (590h19m22.717151725s) [upload=660950]: Next returned nil segment May 25 09:08:10.545048288 (590h19m22.717166698s) [upload=660950]: Waiting for error group managing segments... May 25 09:08:10.656961313 (590h19m22.829079748s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.660492629 (590h19m22.832611053s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.662607276 (590h19m22.834725685s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.666191427 (590h19m22.838309847s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.668082986 (590h19m22.840201397s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.669200102 (590h19m22.841318528s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.674586437 (590h19m22.846704856s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.678894173 (590h19m22.851012593s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679139984 (590h19m22.851258406s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679968043 (590h19m22.852086452s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680106523 (590h19m22.852224947s) [noise=true , address=212.102.52.217:4436 , piece_id=JBR5XJONLHCAETPKBSYIU3Y7I4JFALL2HIFJOMNDOASEWO7P42DQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680935682 (590h19m22.853054103s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.681682946 (590h19m22.853801352s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.686246172 (590h19m22.858364583s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.688393735 (590h19m22.860512145s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690400315 (590h19m22.862518735s) [noise=true , address=212.102.52.217:4440 , piece_id=N3LLXGOYVOLW6LPZJ5PFIPHCNTB4IBPE63EJNGSTRNA7DMMY25AQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690424503 (590h19m22.862542927s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 16 pieces May 25 09:08:10.690668447 (590h19m22.862786875s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.690679709 (590h19m22.862798133s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691127046 (590h19m22.863245472s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iSvBnTTWbzuUHvn6sGakZnV9o8XQ9GTtfA3hL6yupvHaW95Rp): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691136272 (590h19m22.86325469s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691302431 (590h19m22.863420862s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qc5vbvWmHz46Ahoqq32hrEXj5bkFxp7ozxghyu9WN5mwtTSJA): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691312534 (590h19m22.863430965s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691851002 (590h19m22.863969422s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.691894332 (590h19m22.864012753s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 17 pieces May 25 09:08:10.691920976 (590h19m22.864039381s) [seg_pos={0 0}, upload=660950]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:08:10.692199274 (590h19m22.864317694s) [upload=660950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:08:10.692208482 (590h19m22.864326904s) [upload=660950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:08:21.511488298 (590h19m33.683606726s) [upload=660950]: Done uploading segments... May 25 09:08:21.511515102 (590h19m33.683633534s) [upload=660950]: Upload finished. err: <nil> Duration: 2.102388575s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.079629369s trace: https://jaeger.dev.storj.io/trace/61b819dd76ca3968 FAIL (2026-05-25 09:16:22 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== d=660950]: Uploading piece... May 25 09:08:10.059238343 (590h19m22.231356762s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059354538 (590h19m22.231472968s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059771499 (590h19m22.231889918s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059807053 (590h19m22.231925483s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060275645 (590h19m22.232394075s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060307510 (590h19m22.232425946s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.062905295 (590h19m22.235023715s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.064443872 (590h19m22.236562302s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065651209 (590h19m22.23776963s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065970059 (590h19m22.238088482s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.066174389 (590h19m22.238292802s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.067629392 (590h19m22.239747819s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.068738743 (590h19m22.240857171s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.069571471 (590h19m22.241689901s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.070929017 (590h19m22.243047531s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.071635650 (590h19m22.243754069s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.545033315 (590h19m22.717151725s) [upload=660950]: Next returned nil segment May 25 09:08:10.545048288 (590h19m22.717166698s) [upload=660950]: Waiting for error group managing segments... May 25 09:08:10.656961313 (590h19m22.829079748s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.660492629 (590h19m22.832611053s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.662607276 (590h19m22.834725685s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.666191427 (590h19m22.838309847s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.668082986 (590h19m22.840201397s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.669200102 (590h19m22.841318528s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.674586437 (590h19m22.846704856s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.678894173 (590h19m22.851012593s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679139984 (590h19m22.851258406s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679968043 (590h19m22.852086452s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680106523 (590h19m22.852224947s) [noise=true , address=212.102.52.217:4436 , piece_id=JBR5XJONLHCAETPKBSYIU3Y7I4JFALL2HIFJOMNDOASEWO7P42DQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680935682 (590h19m22.853054103s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.681682946 (590h19m22.853801352s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.686246172 (590h19m22.858364583s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.688393735 (590h19m22.860512145s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690400315 (590h19m22.862518735s) [noise=true , address=212.102.52.217:4440 , piece_id=N3LLXGOYVOLW6LPZJ5PFIPHCNTB4IBPE63EJNGSTRNA7DMMY25AQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690424503 (590h19m22.862542927s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 16 pieces May 25 09:08:10.690668447 (590h19m22.862786875s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.690679709 (590h19m22.862798133s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691127046 (590h19m22.863245472s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iSvBnTTWbzuUHvn6sGakZnV9o8XQ9GTtfA3hL6yupvHaW95Rp): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691136272 (590h19m22.86325469s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691302431 (590h19m22.863420862s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qc5vbvWmHz46Ahoqq32hrEXj5bkFxp7ozxghyu9WN5mwtTSJA): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691312534 (590h19m22.863430965s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691851002 (590h19m22.863969422s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.691894332 (590h19m22.864012753s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 17 pieces May 25 09:08:10.691920976 (590h19m22.864039381s) [seg_pos={0 0}, upload=660950]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:08:10.692199274 (590h19m22.864317694s) [upload=660950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:08:10.692208482 (590h19m22.864326904s) [upload=660950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:08:21.511488298 (590h19m33.683606726s) [upload=660950]: Done uploading segments... May 25 09:08:21.511515102 (590h19m33.683633534s) [upload=660950]: Upload finished. err: <nil> Duration: 2.079661104s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.658053332s trace: https://jaeger.dev.storj.io/trace/61b819dd76ca3968 FAIL (2026-05-25 09:16:03 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== d=660950]: Uploading piece... May 25 09:08:10.059238343 (590h19m22.231356762s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059354538 (590h19m22.231472968s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059771499 (590h19m22.231889918s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059807053 (590h19m22.231925483s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060275645 (590h19m22.232394075s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060307510 (590h19m22.232425946s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.062905295 (590h19m22.235023715s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.064443872 (590h19m22.236562302s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065651209 (590h19m22.23776963s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065970059 (590h19m22.238088482s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.066174389 (590h19m22.238292802s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.067629392 (590h19m22.239747819s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.068738743 (590h19m22.240857171s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.069571471 (590h19m22.241689901s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.070929017 (590h19m22.243047531s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.071635650 (590h19m22.243754069s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.545033315 (590h19m22.717151725s) [upload=660950]: Next returned nil segment May 25 09:08:10.545048288 (590h19m22.717166698s) [upload=660950]: Waiting for error group managing segments... May 25 09:08:10.656961313 (590h19m22.829079748s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.660492629 (590h19m22.832611053s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.662607276 (590h19m22.834725685s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.666191427 (590h19m22.838309847s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.668082986 (590h19m22.840201397s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.669200102 (590h19m22.841318528s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.674586437 (590h19m22.846704856s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.678894173 (590h19m22.851012593s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679139984 (590h19m22.851258406s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679968043 (590h19m22.852086452s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680106523 (590h19m22.852224947s) [noise=true , address=212.102.52.217:4436 , piece_id=JBR5XJONLHCAETPKBSYIU3Y7I4JFALL2HIFJOMNDOASEWO7P42DQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680935682 (590h19m22.853054103s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.681682946 (590h19m22.853801352s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.686246172 (590h19m22.858364583s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.688393735 (590h19m22.860512145s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690400315 (590h19m22.862518735s) [noise=true , address=212.102.52.217:4440 , piece_id=N3LLXGOYVOLW6LPZJ5PFIPHCNTB4IBPE63EJNGSTRNA7DMMY25AQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690424503 (590h19m22.862542927s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 16 pieces May 25 09:08:10.690668447 (590h19m22.862786875s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.690679709 (590h19m22.862798133s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691127046 (590h19m22.863245472s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iSvBnTTWbzuUHvn6sGakZnV9o8XQ9GTtfA3hL6yupvHaW95Rp): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691136272 (590h19m22.86325469s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691302431 (590h19m22.863420862s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qc5vbvWmHz46Ahoqq32hrEXj5bkFxp7ozxghyu9WN5mwtTSJA): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691312534 (590h19m22.863430965s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691851002 (590h19m22.863969422s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.691894332 (590h19m22.864012753s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 17 pieces May 25 09:08:10.691920976 (590h19m22.864039381s) [seg_pos={0 0}, upload=660950]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:08:10.692199274 (590h19m22.864317694s) [upload=660950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:08:10.692208482 (590h19m22.864326904s) [upload=660950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:08:21.511488298 (590h19m33.683606726s) [upload=660950]: Done uploading segments... May 25 09:08:21.511515102 (590h19m33.683633534s) [upload=660950]: Upload finished. err: <nil> Duration: 2.658088512s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 3.030698006s trace: https://jaeger.dev.storj.io/trace/61b819dd76ca3968 FAIL (2026-05-25 09:15:20 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== d=660950]: Uploading piece... May 25 09:08:10.059238343 (590h19m22.231356762s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059354538 (590h19m22.231472968s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059771499 (590h19m22.231889918s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059807053 (590h19m22.231925483s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060275645 (590h19m22.232394075s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060307510 (590h19m22.232425946s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.062905295 (590h19m22.235023715s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.064443872 (590h19m22.236562302s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065651209 (590h19m22.23776963s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065970059 (590h19m22.238088482s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.066174389 (590h19m22.238292802s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.067629392 (590h19m22.239747819s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.068738743 (590h19m22.240857171s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.069571471 (590h19m22.241689901s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.070929017 (590h19m22.243047531s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.071635650 (590h19m22.243754069s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.545033315 (590h19m22.717151725s) [upload=660950]: Next returned nil segment May 25 09:08:10.545048288 (590h19m22.717166698s) [upload=660950]: Waiting for error group managing segments... May 25 09:08:10.656961313 (590h19m22.829079748s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.660492629 (590h19m22.832611053s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.662607276 (590h19m22.834725685s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.666191427 (590h19m22.838309847s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.668082986 (590h19m22.840201397s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.669200102 (590h19m22.841318528s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.674586437 (590h19m22.846704856s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.678894173 (590h19m22.851012593s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679139984 (590h19m22.851258406s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679968043 (590h19m22.852086452s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680106523 (590h19m22.852224947s) [noise=true , address=212.102.52.217:4436 , piece_id=JBR5XJONLHCAETPKBSYIU3Y7I4JFALL2HIFJOMNDOASEWO7P42DQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680935682 (590h19m22.853054103s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.681682946 (590h19m22.853801352s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.686246172 (590h19m22.858364583s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.688393735 (590h19m22.860512145s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690400315 (590h19m22.862518735s) [noise=true , address=212.102.52.217:4440 , piece_id=N3LLXGOYVOLW6LPZJ5PFIPHCNTB4IBPE63EJNGSTRNA7DMMY25AQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690424503 (590h19m22.862542927s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 16 pieces May 25 09:08:10.690668447 (590h19m22.862786875s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.690679709 (590h19m22.862798133s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691127046 (590h19m22.863245472s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iSvBnTTWbzuUHvn6sGakZnV9o8XQ9GTtfA3hL6yupvHaW95Rp): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691136272 (590h19m22.86325469s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691302431 (590h19m22.863420862s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qc5vbvWmHz46Ahoqq32hrEXj5bkFxp7ozxghyu9WN5mwtTSJA): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691312534 (590h19m22.863430965s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691851002 (590h19m22.863969422s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.691894332 (590h19m22.864012753s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 17 pieces May 25 09:08:10.691920976 (590h19m22.864039381s) [seg_pos={0 0}, upload=660950]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:08:10.692199274 (590h19m22.864317694s) [upload=660950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:08:10.692208482 (590h19m22.864326904s) [upload=660950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:08:21.511488298 (590h19m33.683606726s) [upload=660950]: Done uploading segments... May 25 09:08:21.511515102 (590h19m33.683633534s) [upload=660950]: Upload finished. err: <nil> Duration: 3.030741376s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.054888762s trace: https://jaeger.dev.storj.io/trace/61b819dd76ca3968 FAIL (2026-05-25 09:14:22 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== d=660950]: Uploading piece... May 25 09:08:10.059238343 (590h19m22.231356762s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059354538 (590h19m22.231472968s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059771499 (590h19m22.231889918s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059807053 (590h19m22.231925483s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060275645 (590h19m22.232394075s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060307510 (590h19m22.232425946s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.062905295 (590h19m22.235023715s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.064443872 (590h19m22.236562302s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065651209 (590h19m22.23776963s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065970059 (590h19m22.238088482s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.066174389 (590h19m22.238292802s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.067629392 (590h19m22.239747819s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.068738743 (590h19m22.240857171s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.069571471 (590h19m22.241689901s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.070929017 (590h19m22.243047531s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.071635650 (590h19m22.243754069s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.545033315 (590h19m22.717151725s) [upload=660950]: Next returned nil segment May 25 09:08:10.545048288 (590h19m22.717166698s) [upload=660950]: Waiting for error group managing segments... May 25 09:08:10.656961313 (590h19m22.829079748s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.660492629 (590h19m22.832611053s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.662607276 (590h19m22.834725685s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.666191427 (590h19m22.838309847s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.668082986 (590h19m22.840201397s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.669200102 (590h19m22.841318528s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.674586437 (590h19m22.846704856s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.678894173 (590h19m22.851012593s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679139984 (590h19m22.851258406s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679968043 (590h19m22.852086452s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680106523 (590h19m22.852224947s) [noise=true , address=212.102.52.217:4436 , piece_id=JBR5XJONLHCAETPKBSYIU3Y7I4JFALL2HIFJOMNDOASEWO7P42DQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680935682 (590h19m22.853054103s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.681682946 (590h19m22.853801352s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.686246172 (590h19m22.858364583s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.688393735 (590h19m22.860512145s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690400315 (590h19m22.862518735s) [noise=true , address=212.102.52.217:4440 , piece_id=N3LLXGOYVOLW6LPZJ5PFIPHCNTB4IBPE63EJNGSTRNA7DMMY25AQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690424503 (590h19m22.862542927s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 16 pieces May 25 09:08:10.690668447 (590h19m22.862786875s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.690679709 (590h19m22.862798133s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691127046 (590h19m22.863245472s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iSvBnTTWbzuUHvn6sGakZnV9o8XQ9GTtfA3hL6yupvHaW95Rp): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691136272 (590h19m22.86325469s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691302431 (590h19m22.863420862s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qc5vbvWmHz46Ahoqq32hrEXj5bkFxp7ozxghyu9WN5mwtTSJA): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691312534 (590h19m22.863430965s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691851002 (590h19m22.863969422s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.691894332 (590h19m22.864012753s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 17 pieces May 25 09:08:10.691920976 (590h19m22.864039381s) [seg_pos={0 0}, upload=660950]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:08:10.692199274 (590h19m22.864317694s) [upload=660950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:08:10.692208482 (590h19m22.864326904s) [upload=660950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:08:21.511488298 (590h19m33.683606726s) [upload=660950]: Done uploading segments... May 25 09:08:21.511515102 (590h19m33.683633534s) [upload=660950]: Upload finished. err: <nil> Duration: 2.05492771s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.042711049s trace: https://jaeger.dev.storj.io/trace/61b819dd76ca3968 FAIL (2026-05-25 09:13:53 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== d=660950]: Uploading piece... May 25 09:08:10.059238343 (590h19m22.231356762s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059354538 (590h19m22.231472968s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059771499 (590h19m22.231889918s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059807053 (590h19m22.231925483s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060275645 (590h19m22.232394075s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060307510 (590h19m22.232425946s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.062905295 (590h19m22.235023715s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.064443872 (590h19m22.236562302s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065651209 (590h19m22.23776963s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065970059 (590h19m22.238088482s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.066174389 (590h19m22.238292802s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.067629392 (590h19m22.239747819s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.068738743 (590h19m22.240857171s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.069571471 (590h19m22.241689901s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.070929017 (590h19m22.243047531s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.071635650 (590h19m22.243754069s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.545033315 (590h19m22.717151725s) [upload=660950]: Next returned nil segment May 25 09:08:10.545048288 (590h19m22.717166698s) [upload=660950]: Waiting for error group managing segments... May 25 09:08:10.656961313 (590h19m22.829079748s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.660492629 (590h19m22.832611053s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.662607276 (590h19m22.834725685s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.666191427 (590h19m22.838309847s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.668082986 (590h19m22.840201397s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.669200102 (590h19m22.841318528s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.674586437 (590h19m22.846704856s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.678894173 (590h19m22.851012593s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679139984 (590h19m22.851258406s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679968043 (590h19m22.852086452s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680106523 (590h19m22.852224947s) [noise=true , address=212.102.52.217:4436 , piece_id=JBR5XJONLHCAETPKBSYIU3Y7I4JFALL2HIFJOMNDOASEWO7P42DQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680935682 (590h19m22.853054103s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.681682946 (590h19m22.853801352s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.686246172 (590h19m22.858364583s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.688393735 (590h19m22.860512145s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690400315 (590h19m22.862518735s) [noise=true , address=212.102.52.217:4440 , piece_id=N3LLXGOYVOLW6LPZJ5PFIPHCNTB4IBPE63EJNGSTRNA7DMMY25AQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690424503 (590h19m22.862542927s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 16 pieces May 25 09:08:10.690668447 (590h19m22.862786875s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.690679709 (590h19m22.862798133s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691127046 (590h19m22.863245472s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iSvBnTTWbzuUHvn6sGakZnV9o8XQ9GTtfA3hL6yupvHaW95Rp): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691136272 (590h19m22.86325469s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691302431 (590h19m22.863420862s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qc5vbvWmHz46Ahoqq32hrEXj5bkFxp7ozxghyu9WN5mwtTSJA): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691312534 (590h19m22.863430965s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691851002 (590h19m22.863969422s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.691894332 (590h19m22.864012753s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 17 pieces May 25 09:08:10.691920976 (590h19m22.864039381s) [seg_pos={0 0}, upload=660950]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:08:10.692199274 (590h19m22.864317694s) [upload=660950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:08:10.692208482 (590h19m22.864326904s) [upload=660950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:08:21.511488298 (590h19m33.683606726s) [upload=660950]: Done uploading segments... May 25 09:08:21.511515102 (590h19m33.683633534s) [upload=660950]: Upload finished. err: <nil> Duration: 2.042740207s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 1.9428013s trace: https://jaeger.dev.storj.io/trace/61b819dd76ca3968 FAIL (2026-05-25 09:13:34 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== d=660950]: Uploading piece... May 25 09:08:10.059238343 (590h19m22.231356762s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059354538 (590h19m22.231472968s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059771499 (590h19m22.231889918s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059807053 (590h19m22.231925483s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060275645 (590h19m22.232394075s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060307510 (590h19m22.232425946s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.062905295 (590h19m22.235023715s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.064443872 (590h19m22.236562302s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065651209 (590h19m22.23776963s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065970059 (590h19m22.238088482s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.066174389 (590h19m22.238292802s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.067629392 (590h19m22.239747819s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.068738743 (590h19m22.240857171s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.069571471 (590h19m22.241689901s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.070929017 (590h19m22.243047531s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.071635650 (590h19m22.243754069s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.545033315 (590h19m22.717151725s) [upload=660950]: Next returned nil segment May 25 09:08:10.545048288 (590h19m22.717166698s) [upload=660950]: Waiting for error group managing segments... May 25 09:08:10.656961313 (590h19m22.829079748s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.660492629 (590h19m22.832611053s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.662607276 (590h19m22.834725685s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.666191427 (590h19m22.838309847s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.668082986 (590h19m22.840201397s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.669200102 (590h19m22.841318528s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.674586437 (590h19m22.846704856s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.678894173 (590h19m22.851012593s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679139984 (590h19m22.851258406s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679968043 (590h19m22.852086452s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680106523 (590h19m22.852224947s) [noise=true , address=212.102.52.217:4436 , piece_id=JBR5XJONLHCAETPKBSYIU3Y7I4JFALL2HIFJOMNDOASEWO7P42DQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680935682 (590h19m22.853054103s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.681682946 (590h19m22.853801352s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.686246172 (590h19m22.858364583s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.688393735 (590h19m22.860512145s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690400315 (590h19m22.862518735s) [noise=true , address=212.102.52.217:4440 , piece_id=N3LLXGOYVOLW6LPZJ5PFIPHCNTB4IBPE63EJNGSTRNA7DMMY25AQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690424503 (590h19m22.862542927s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 16 pieces May 25 09:08:10.690668447 (590h19m22.862786875s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.690679709 (590h19m22.862798133s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691127046 (590h19m22.863245472s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iSvBnTTWbzuUHvn6sGakZnV9o8XQ9GTtfA3hL6yupvHaW95Rp): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691136272 (590h19m22.86325469s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691302431 (590h19m22.863420862s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qc5vbvWmHz46Ahoqq32hrEXj5bkFxp7ozxghyu9WN5mwtTSJA): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691312534 (590h19m22.863430965s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691851002 (590h19m22.863969422s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.691894332 (590h19m22.864012753s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 17 pieces May 25 09:08:10.691920976 (590h19m22.864039381s) [seg_pos={0 0}, upload=660950]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:08:10.692199274 (590h19m22.864317694s) [upload=660950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:08:10.692208482 (590h19m22.864326904s) [upload=660950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:08:21.511488298 (590h19m33.683606726s) [upload=660950]: Done uploading segments... May 25 09:08:21.511515102 (590h19m33.683633534s) [upload=660950]: Upload finished. err: <nil> Duration: 1.942826384s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 33.926030823s trace: https://jaeger.dev.storj.io/trace/61b819dd76ca3968 FAIL (2026-05-25 09:13:31 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== d=660950]: Uploading piece... May 25 09:08:10.059238343 (590h19m22.231356762s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059354538 (590h19m22.231472968s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059771499 (590h19m22.231889918s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059807053 (590h19m22.231925483s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060275645 (590h19m22.232394075s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060307510 (590h19m22.232425946s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.062905295 (590h19m22.235023715s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.064443872 (590h19m22.236562302s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065651209 (590h19m22.23776963s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065970059 (590h19m22.238088482s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.066174389 (590h19m22.238292802s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.067629392 (590h19m22.239747819s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.068738743 (590h19m22.240857171s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.069571471 (590h19m22.241689901s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.070929017 (590h19m22.243047531s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.071635650 (590h19m22.243754069s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.545033315 (590h19m22.717151725s) [upload=660950]: Next returned nil segment May 25 09:08:10.545048288 (590h19m22.717166698s) [upload=660950]: Waiting for error group managing segments... May 25 09:08:10.656961313 (590h19m22.829079748s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.660492629 (590h19m22.832611053s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.662607276 (590h19m22.834725685s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.666191427 (590h19m22.838309847s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.668082986 (590h19m22.840201397s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.669200102 (590h19m22.841318528s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.674586437 (590h19m22.846704856s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.678894173 (590h19m22.851012593s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679139984 (590h19m22.851258406s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679968043 (590h19m22.852086452s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680106523 (590h19m22.852224947s) [noise=true , address=212.102.52.217:4436 , piece_id=JBR5XJONLHCAETPKBSYIU3Y7I4JFALL2HIFJOMNDOASEWO7P42DQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680935682 (590h19m22.853054103s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.681682946 (590h19m22.853801352s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.686246172 (590h19m22.858364583s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.688393735 (590h19m22.860512145s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690400315 (590h19m22.862518735s) [noise=true , address=212.102.52.217:4440 , piece_id=N3LLXGOYVOLW6LPZJ5PFIPHCNTB4IBPE63EJNGSTRNA7DMMY25AQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690424503 (590h19m22.862542927s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 16 pieces May 25 09:08:10.690668447 (590h19m22.862786875s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.690679709 (590h19m22.862798133s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691127046 (590h19m22.863245472s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iSvBnTTWbzuUHvn6sGakZnV9o8XQ9GTtfA3hL6yupvHaW95Rp): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691136272 (590h19m22.86325469s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691302431 (590h19m22.863420862s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qc5vbvWmHz46Ahoqq32hrEXj5bkFxp7ozxghyu9WN5mwtTSJA): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691312534 (590h19m22.863430965s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691851002 (590h19m22.863969422s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.691894332 (590h19m22.864012753s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 17 pieces May 25 09:08:10.691920976 (590h19m22.864039381s) [seg_pos={0 0}, upload=660950]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:08:10.692199274 (590h19m22.864317694s) [upload=660950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:08:10.692208482 (590h19m22.864326904s) [upload=660950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:08:21.511488298 (590h19m33.683606726s) [upload=660950]: Done uploading segments... May 25 09:08:21.511515102 (590h19m33.683633534s) [upload=660950]: Upload finished. err: <nil> Duration: 33.926061016s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.698660206s trace: https://jaeger.dev.storj.io/trace/61b819dd76ca3968 FAIL (2026-05-25 09:11:47 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== d=660950]: Uploading piece... May 25 09:08:10.059238343 (590h19m22.231356762s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059354538 (590h19m22.231472968s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059771499 (590h19m22.231889918s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059807053 (590h19m22.231925483s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060275645 (590h19m22.232394075s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060307510 (590h19m22.232425946s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.062905295 (590h19m22.235023715s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.064443872 (590h19m22.236562302s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065651209 (590h19m22.23776963s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065970059 (590h19m22.238088482s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.066174389 (590h19m22.238292802s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.067629392 (590h19m22.239747819s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.068738743 (590h19m22.240857171s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.069571471 (590h19m22.241689901s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.070929017 (590h19m22.243047531s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.071635650 (590h19m22.243754069s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.545033315 (590h19m22.717151725s) [upload=660950]: Next returned nil segment May 25 09:08:10.545048288 (590h19m22.717166698s) [upload=660950]: Waiting for error group managing segments... May 25 09:08:10.656961313 (590h19m22.829079748s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.660492629 (590h19m22.832611053s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.662607276 (590h19m22.834725685s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.666191427 (590h19m22.838309847s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.668082986 (590h19m22.840201397s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.669200102 (590h19m22.841318528s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.674586437 (590h19m22.846704856s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.678894173 (590h19m22.851012593s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679139984 (590h19m22.851258406s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679968043 (590h19m22.852086452s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680106523 (590h19m22.852224947s) [noise=true , address=212.102.52.217:4436 , piece_id=JBR5XJONLHCAETPKBSYIU3Y7I4JFALL2HIFJOMNDOASEWO7P42DQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680935682 (590h19m22.853054103s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.681682946 (590h19m22.853801352s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.686246172 (590h19m22.858364583s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.688393735 (590h19m22.860512145s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690400315 (590h19m22.862518735s) [noise=true , address=212.102.52.217:4440 , piece_id=N3LLXGOYVOLW6LPZJ5PFIPHCNTB4IBPE63EJNGSTRNA7DMMY25AQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690424503 (590h19m22.862542927s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 16 pieces May 25 09:08:10.690668447 (590h19m22.862786875s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.690679709 (590h19m22.862798133s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691127046 (590h19m22.863245472s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iSvBnTTWbzuUHvn6sGakZnV9o8XQ9GTtfA3hL6yupvHaW95Rp): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691136272 (590h19m22.86325469s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691302431 (590h19m22.863420862s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qc5vbvWmHz46Ahoqq32hrEXj5bkFxp7ozxghyu9WN5mwtTSJA): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691312534 (590h19m22.863430965s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691851002 (590h19m22.863969422s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.691894332 (590h19m22.864012753s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 17 pieces May 25 09:08:10.691920976 (590h19m22.864039381s) [seg_pos={0 0}, upload=660950]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:08:10.692199274 (590h19m22.864317694s) [upload=660950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:08:10.692208482 (590h19m22.864326904s) [upload=660950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:08:21.511488298 (590h19m33.683606726s) [upload=660950]: Done uploading segments... May 25 09:08:21.511515102 (590h19m33.683633534s) [upload=660950]: Upload finished. err: <nil> Duration: 2.698695853s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 3.997837669s trace: https://jaeger.dev.storj.io/trace/61b819dd76ca3968 FAIL (2026-05-25 09:11:17 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== d=660950]: Uploading piece... May 25 09:08:10.059238343 (590h19m22.231356762s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059354538 (590h19m22.231472968s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059771499 (590h19m22.231889918s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059807053 (590h19m22.231925483s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060275645 (590h19m22.232394075s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060307510 (590h19m22.232425946s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.062905295 (590h19m22.235023715s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.064443872 (590h19m22.236562302s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065651209 (590h19m22.23776963s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065970059 (590h19m22.238088482s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.066174389 (590h19m22.238292802s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.067629392 (590h19m22.239747819s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.068738743 (590h19m22.240857171s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.069571471 (590h19m22.241689901s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.070929017 (590h19m22.243047531s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.071635650 (590h19m22.243754069s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.545033315 (590h19m22.717151725s) [upload=660950]: Next returned nil segment May 25 09:08:10.545048288 (590h19m22.717166698s) [upload=660950]: Waiting for error group managing segments... May 25 09:08:10.656961313 (590h19m22.829079748s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.660492629 (590h19m22.832611053s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.662607276 (590h19m22.834725685s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.666191427 (590h19m22.838309847s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.668082986 (590h19m22.840201397s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.669200102 (590h19m22.841318528s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.674586437 (590h19m22.846704856s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.678894173 (590h19m22.851012593s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679139984 (590h19m22.851258406s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679968043 (590h19m22.852086452s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680106523 (590h19m22.852224947s) [noise=true , address=212.102.52.217:4436 , piece_id=JBR5XJONLHCAETPKBSYIU3Y7I4JFALL2HIFJOMNDOASEWO7P42DQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680935682 (590h19m22.853054103s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.681682946 (590h19m22.853801352s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.686246172 (590h19m22.858364583s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.688393735 (590h19m22.860512145s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690400315 (590h19m22.862518735s) [noise=true , address=212.102.52.217:4440 , piece_id=N3LLXGOYVOLW6LPZJ5PFIPHCNTB4IBPE63EJNGSTRNA7DMMY25AQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690424503 (590h19m22.862542927s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 16 pieces May 25 09:08:10.690668447 (590h19m22.862786875s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.690679709 (590h19m22.862798133s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691127046 (590h19m22.863245472s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iSvBnTTWbzuUHvn6sGakZnV9o8XQ9GTtfA3hL6yupvHaW95Rp): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691136272 (590h19m22.86325469s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691302431 (590h19m22.863420862s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qc5vbvWmHz46Ahoqq32hrEXj5bkFxp7ozxghyu9WN5mwtTSJA): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691312534 (590h19m22.863430965s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691851002 (590h19m22.863969422s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.691894332 (590h19m22.864012753s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 17 pieces May 25 09:08:10.691920976 (590h19m22.864039381s) [seg_pos={0 0}, upload=660950]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:08:10.692199274 (590h19m22.864317694s) [upload=660950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:08:10.692208482 (590h19m22.864326904s) [upload=660950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:08:21.511488298 (590h19m33.683606726s) [upload=660950]: Done uploading segments... May 25 09:08:21.511515102 (590h19m33.683633534s) [upload=660950]: Upload finished. err: <nil> Duration: 3.997863414s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [X.......................................................X...] duration: 2.394113826s trace: https://jaeger.dev.storj.io/trace/61b819dd76ca3968 FAIL (2026-05-25 09:10:38 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== d=660950]: Uploading piece... May 25 09:08:10.059238343 (590h19m22.231356762s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059354538 (590h19m22.231472968s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059771499 (590h19m22.231889918s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059807053 (590h19m22.231925483s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060275645 (590h19m22.232394075s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060307510 (590h19m22.232425946s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.062905295 (590h19m22.235023715s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.064443872 (590h19m22.236562302s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065651209 (590h19m22.23776963s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065970059 (590h19m22.238088482s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.066174389 (590h19m22.238292802s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.067629392 (590h19m22.239747819s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.068738743 (590h19m22.240857171s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.069571471 (590h19m22.241689901s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.070929017 (590h19m22.243047531s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.071635650 (590h19m22.243754069s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.545033315 (590h19m22.717151725s) [upload=660950]: Next returned nil segment May 25 09:08:10.545048288 (590h19m22.717166698s) [upload=660950]: Waiting for error group managing segments... May 25 09:08:10.656961313 (590h19m22.829079748s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.660492629 (590h19m22.832611053s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.662607276 (590h19m22.834725685s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.666191427 (590h19m22.838309847s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.668082986 (590h19m22.840201397s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.669200102 (590h19m22.841318528s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.674586437 (590h19m22.846704856s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.678894173 (590h19m22.851012593s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679139984 (590h19m22.851258406s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679968043 (590h19m22.852086452s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680106523 (590h19m22.852224947s) [noise=true , address=212.102.52.217:4436 , piece_id=JBR5XJONLHCAETPKBSYIU3Y7I4JFALL2HIFJOMNDOASEWO7P42DQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680935682 (590h19m22.853054103s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.681682946 (590h19m22.853801352s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.686246172 (590h19m22.858364583s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.688393735 (590h19m22.860512145s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690400315 (590h19m22.862518735s) [noise=true , address=212.102.52.217:4440 , piece_id=N3LLXGOYVOLW6LPZJ5PFIPHCNTB4IBPE63EJNGSTRNA7DMMY25AQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690424503 (590h19m22.862542927s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 16 pieces May 25 09:08:10.690668447 (590h19m22.862786875s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.690679709 (590h19m22.862798133s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691127046 (590h19m22.863245472s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iSvBnTTWbzuUHvn6sGakZnV9o8XQ9GTtfA3hL6yupvHaW95Rp): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691136272 (590h19m22.86325469s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691302431 (590h19m22.863420862s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qc5vbvWmHz46Ahoqq32hrEXj5bkFxp7ozxghyu9WN5mwtTSJA): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691312534 (590h19m22.863430965s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691851002 (590h19m22.863969422s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.691894332 (590h19m22.864012753s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 17 pieces May 25 09:08:10.691920976 (590h19m22.864039381s) [seg_pos={0 0}, upload=660950]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:08:10.692199274 (590h19m22.864317694s) [upload=660950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:08:10.692208482 (590h19m22.864326904s) [upload=660950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:08:21.511488298 (590h19m33.683606726s) [upload=660950]: Done uploading segments... May 25 09:08:21.511515102 (590h19m33.683633534s) [upload=660950]: Upload finished. err: <nil> Duration: 2.394149453s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.X.......................................................X..] duration: 2.028651051s trace: https://jaeger.dev.storj.io/trace/61b819dd76ca3968 FAIL (2026-05-25 09:09:53 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== d=660950]: Uploading piece... May 25 09:08:10.059238343 (590h19m22.231356762s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059354538 (590h19m22.231472968s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059771499 (590h19m22.231889918s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059807053 (590h19m22.231925483s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060275645 (590h19m22.232394075s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060307510 (590h19m22.232425946s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.062905295 (590h19m22.235023715s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.064443872 (590h19m22.236562302s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065651209 (590h19m22.23776963s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065970059 (590h19m22.238088482s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.066174389 (590h19m22.238292802s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.067629392 (590h19m22.239747819s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.068738743 (590h19m22.240857171s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.069571471 (590h19m22.241689901s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.070929017 (590h19m22.243047531s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.071635650 (590h19m22.243754069s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.545033315 (590h19m22.717151725s) [upload=660950]: Next returned nil segment May 25 09:08:10.545048288 (590h19m22.717166698s) [upload=660950]: Waiting for error group managing segments... May 25 09:08:10.656961313 (590h19m22.829079748s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.660492629 (590h19m22.832611053s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.662607276 (590h19m22.834725685s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.666191427 (590h19m22.838309847s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.668082986 (590h19m22.840201397s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.669200102 (590h19m22.841318528s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.674586437 (590h19m22.846704856s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.678894173 (590h19m22.851012593s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679139984 (590h19m22.851258406s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679968043 (590h19m22.852086452s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680106523 (590h19m22.852224947s) [noise=true , address=212.102.52.217:4436 , piece_id=JBR5XJONLHCAETPKBSYIU3Y7I4JFALL2HIFJOMNDOASEWO7P42DQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680935682 (590h19m22.853054103s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.681682946 (590h19m22.853801352s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.686246172 (590h19m22.858364583s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.688393735 (590h19m22.860512145s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690400315 (590h19m22.862518735s) [noise=true , address=212.102.52.217:4440 , piece_id=N3LLXGOYVOLW6LPZJ5PFIPHCNTB4IBPE63EJNGSTRNA7DMMY25AQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690424503 (590h19m22.862542927s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 16 pieces May 25 09:08:10.690668447 (590h19m22.862786875s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.690679709 (590h19m22.862798133s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691127046 (590h19m22.863245472s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iSvBnTTWbzuUHvn6sGakZnV9o8XQ9GTtfA3hL6yupvHaW95Rp): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691136272 (590h19m22.86325469s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691302431 (590h19m22.863420862s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qc5vbvWmHz46Ahoqq32hrEXj5bkFxp7ozxghyu9WN5mwtTSJA): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691312534 (590h19m22.863430965s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691851002 (590h19m22.863969422s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.691894332 (590h19m22.864012753s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 17 pieces May 25 09:08:10.691920976 (590h19m22.864039381s) [seg_pos={0 0}, upload=660950]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:08:10.692199274 (590h19m22.864317694s) [upload=660950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:08:10.692208482 (590h19m22.864326904s) [upload=660950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:08:21.511488298 (590h19m33.683606726s) [upload=660950]: Done uploading segments... May 25 09:08:21.511515102 (590h19m33.683633534s) [upload=660950]: Upload finished. err: <nil> Duration: 2.028687016s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..X.......................................................X.] duration: 6.009742904s trace: https://jaeger.dev.storj.io/trace/61b819dd76ca3968 FAIL (2026-05-25 09:08:47 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== d=660950]: Uploading piece... May 25 09:08:10.059238343 (590h19m22.231356762s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059354538 (590h19m22.231472968s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059771499 (590h19m22.231889918s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059807053 (590h19m22.231925483s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060275645 (590h19m22.232394075s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060307510 (590h19m22.232425946s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.062905295 (590h19m22.235023715s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.064443872 (590h19m22.236562302s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065651209 (590h19m22.23776963s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065970059 (590h19m22.238088482s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.066174389 (590h19m22.238292802s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.067629392 (590h19m22.239747819s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.068738743 (590h19m22.240857171s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.069571471 (590h19m22.241689901s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.070929017 (590h19m22.243047531s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.071635650 (590h19m22.243754069s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.545033315 (590h19m22.717151725s) [upload=660950]: Next returned nil segment May 25 09:08:10.545048288 (590h19m22.717166698s) [upload=660950]: Waiting for error group managing segments... May 25 09:08:10.656961313 (590h19m22.829079748s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.660492629 (590h19m22.832611053s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.662607276 (590h19m22.834725685s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.666191427 (590h19m22.838309847s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.668082986 (590h19m22.840201397s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.669200102 (590h19m22.841318528s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.674586437 (590h19m22.846704856s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.678894173 (590h19m22.851012593s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679139984 (590h19m22.851258406s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679968043 (590h19m22.852086452s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680106523 (590h19m22.852224947s) [noise=true , address=212.102.52.217:4436 , piece_id=JBR5XJONLHCAETPKBSYIU3Y7I4JFALL2HIFJOMNDOASEWO7P42DQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680935682 (590h19m22.853054103s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.681682946 (590h19m22.853801352s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.686246172 (590h19m22.858364583s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.688393735 (590h19m22.860512145s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690400315 (590h19m22.862518735s) [noise=true , address=212.102.52.217:4440 , piece_id=N3LLXGOYVOLW6LPZJ5PFIPHCNTB4IBPE63EJNGSTRNA7DMMY25AQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690424503 (590h19m22.862542927s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 16 pieces May 25 09:08:10.690668447 (590h19m22.862786875s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.690679709 (590h19m22.862798133s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691127046 (590h19m22.863245472s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iSvBnTTWbzuUHvn6sGakZnV9o8XQ9GTtfA3hL6yupvHaW95Rp): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691136272 (590h19m22.86325469s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691302431 (590h19m22.863420862s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qc5vbvWmHz46Ahoqq32hrEXj5bkFxp7ozxghyu9WN5mwtTSJA): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691312534 (590h19m22.863430965s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691851002 (590h19m22.863969422s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.691894332 (590h19m22.864012753s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 17 pieces May 25 09:08:10.691920976 (590h19m22.864039381s) [seg_pos={0 0}, upload=660950]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:08:10.692199274 (590h19m22.864317694s) [upload=660950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:08:10.692208482 (590h19m22.864326904s) [upload=660950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:08:21.511488298 (590h19m33.683606726s) [upload=660950]: Done uploading segments... May 25 09:08:21.511515102 (590h19m33.683633534s) [upload=660950]: Upload finished. err: <nil> Duration: 6.009787959s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 3 out of 60 is failed (threshold=3) [X..X.......................................................X] duration: 1m0.003710576s trace: https://jaeger.dev.storj.io/trace/61b819dd76ca3968 FAIL (2026-05-25 09:08:35 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== d=660950]: Uploading piece... May 25 09:08:10.059238343 (590h19m22.231356762s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059354538 (590h19m22.231472968s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059771499 (590h19m22.231889918s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.059807053 (590h19m22.231925483s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060275645 (590h19m22.232394075s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.060307510 (590h19m22.232425946s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.062905295 (590h19m22.235023715s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.064443872 (590h19m22.236562302s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065651209 (590h19m22.23776963s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.065970059 (590h19m22.238088482s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.066174389 (590h19m22.238292802s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.067629392 (590h19m22.239747819s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.068738743 (590h19m22.240857171s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.069571471 (590h19m22.241689901s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.070929017 (590h19m22.243047531s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.071635650 (590h19m22.243754069s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Uploading piece... May 25 09:08:10.545033315 (590h19m22.717151725s) [upload=660950]: Next returned nil segment May 25 09:08:10.545048288 (590h19m22.717166698s) [upload=660950]: Waiting for error group managing segments... May 25 09:08:10.656961313 (590h19m22.829079748s) [noise=true , address=212.102.52.214:4365 , piece_id=KR5CXOOTRLQS7G3UZSOJFDUKBEVPA52JQP6HOJ5JES4KHQLGA6WQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.660492629 (590h19m22.832611053s) [noise=true , address=212.102.52.216:4411 , piece_id=EVWW2JGYP7VBY4BB62G4SY6EVTJEDTI2E35VZZXELNRQRTVRW34Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.662607276 (590h19m22.834725685s) [noise=true , address=212.102.52.216:4398 , piece_id=RAMIRXTEWDXHX6L4H44KROLI7LBJKDVBAC2QLBCP7R4MYZZBKRQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.666191427 (590h19m22.838309847s) [noise=true , address=212.102.52.213:4336 , piece_id=23CXJD373NS2DZ3HG3BB3T72YMNEZWUJKH6UNNDTML2UAD2UOEFA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.668082986 (590h19m22.840201397s) [noise=true , address=212.102.52.214:4349 , piece_id=DM7B52P3AJ5CSBPZL6XFYWFTCDVVUVPDCXUOHXSOA7RGWPOITZQQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.669200102 (590h19m22.841318528s) [noise=true , address=212.102.52.215:4377 , piece_id=2HVYRE3UD7LRJO5B2HE5AXC6KDUIIOMS6427HWX6JUJYI56BJB6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.674586437 (590h19m22.846704856s) [noise=true , address=212.102.52.215:4370 , piece_id=S7XCTCDHLCAP5TEAIJPM25NPC3DY2GFMUASRIIF53IQVPI5HEJSQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.678894173 (590h19m22.851012593s) [noise=true , address=212.102.52.215:4369 , piece_id=FOEYE5FZVD7GQ5AQKKIEODMFKQB5J4A2LUKNNMZZN5GILZW6VKLQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679139984 (590h19m22.851258406s) [noise=true , address=212.102.52.213:4330 , piece_id=XHQVENZ5RIE7N2SF633DN2KNKA7O7EHJS3VIMKYOWYLY4ASD3WGA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.679968043 (590h19m22.852086452s) [noise=true , address=212.102.52.213:4338 , piece_id=BNLTRH3FLK5ESL5P42PDMLA4XQ6YGUAPXKUB7PRKITZMV7EJWHDA, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680106523 (590h19m22.852224947s) [noise=true , address=212.102.52.217:4436 , piece_id=JBR5XJONLHCAETPKBSYIU3Y7I4JFALL2HIFJOMNDOASEWO7P42DQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.680935682 (590h19m22.853054103s) [noise=true , address=212.102.52.214:4358 , piece_id=TL6ATN6DJK2VFURSWCLGHWGA365ALOQQKU4XFM555LAFQHUZCU7Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.681682946 (590h19m22.853801352s) [noise=true , address=212.102.52.217:4426 , piece_id=UDI5WKC2KONDZM3CRHXHTZ7L5VI2NEDVTRMG6AC7G6GWMTO2VN6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.686246172 (590h19m22.858364583s) [noise=true , address=212.102.52.216:4401 , piece_id=RGEOG3TPOXJVXEEF2O4DS77726RR3ZQINQ55XUOI4OQKGXAJ7VMQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.688393735 (590h19m22.860512145s) [noise=true , address=212.102.52.216:4406 , piece_id=5N2F6KHQRZ7KSVC3OUGJQQN5IYMCJR4V5DZI4445EIL5LLU4GP2Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690400315 (590h19m22.862518735s) [noise=true , address=212.102.52.217:4440 , piece_id=N3LLXGOYVOLW6LPZJ5PFIPHCNTB4IBPE63EJNGSTRNA7DMMY25AQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.690424503 (590h19m22.862542927s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 16 pieces May 25 09:08:10.690668447 (590h19m22.862786875s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1advc6gw7eb8pr1vTDHh2xMBzKHAy1TPnVUt4pHZW7jPxPpFmY): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.690679709 (590h19m22.862798133s) [noise=true , address=212.102.52.217:4425 , piece_id=VTEPN3YWVVZ4CP3RH55Z3OMO7VYBJLURWQFGNCDELNIIFN7ADWHQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691127046 (590h19m22.863245472s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12iSvBnTTWbzuUHvn6sGakZnV9o8XQ9GTtfA3hL6yupvHaW95Rp): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691136272 (590h19m22.86325469s) [noise=true , address=212.102.52.215:4374 , piece_id=3K3EFEZ53ZNIDO5NLYB3HYQ5I7P2LINBHKLQHNMM7Z6KOWOHRKFQ, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691302431 (590h19m22.863420862s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1Qc5vbvWmHz46Ahoqq32hrEXj5bkFxp7ozxghyu9WN5mwtTSJA): protocol: expected piece hash; context canceled; EOF May 25 09:08:10.691312534 (590h19m22.863430965s) [noise=true , address=212.102.52.214:4359 , piece_id=KQZ6ID6AO33SYQVRXBC7N55EXYCKWIGAOQT66H3TZCBIUMFR547Q, seg_pos={0 0}, upload=660950]: Long tail cancellation due to optimal threshold May 25 09:08:10.691851002 (590h19m22.863969422s) [noise=true , address=212.102.52.213:4344 , piece_id=UVIUCNRKUCKNHOM5FEIRG2CYQAB5LR2HFRRP5JTVMJRFRYCXCV6Q, seg_pos={0 0}, upload=660950]: Done uploading piece. err: <nil> May 25 09:08:10.691894332 (590h19m22.864012753s) [seg_pos={0 0}, upload=660950]: Satisfied cohort requirements after 17 pieces May 25 09:08:10.691920976 (590h19m22.864039381s) [seg_pos={0 0}, upload=660950]: Done waiting for segment. successful: 17 optimal: 16 errs: <nil> May 25 09:08:10.692199274 (590h19m22.864317694s) [upload=660950]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 09:08:10.692208482 (590h19m22.864326904s) [upload=660950]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 09:08:21.511488298 (590h19m33.683606726s) [upload=660950]: Done uploading segments... May 25 09:08:21.511515102 (590h19m33.683633534s) [upload=660950]: Upload finished. err: <nil> Duration: 1m0.003767102s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.X..X.......................................................] duration: 2.480056962s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 09:06:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.480086592s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..X..X......................................................] duration: 1.927195447s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 09:05:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.927299602s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...X..X.....................................................] duration: 1.9321124s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 09:05:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.932142602s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [....X..X....................................................] duration: 1.944157059s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 09:04:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.944193662s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.....X..X...................................................] duration: 2.006448486s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 09:04:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.006543183s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [......X..X..................................................] duration: 2.172047689s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 09:03:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.172173064s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.......X..X.................................................] duration: 2.020427181s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 09:02:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.020452955s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [........X..X................................................] duration: 1.949363406s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 09:01:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.949393492s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.........X..X...............................................] duration: 1.923306318s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 09:01:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.923340569s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..........X..X..............................................] duration: 11.550710738s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 09:00:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 11.550742509s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...........X..X.............................................] duration: 1.990180426s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:59:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.99020883s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [............X..X............................................] duration: 3.201377541s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:58:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 3.201413179s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.............X..X...........................................] duration: 2.088163343s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:58:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.088190052s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [..............X..X..........................................] duration: 2.277932651s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:57:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.277975044s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [...............X..X.........................................] duration: 2.131399881s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:56:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.131498635s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [................X..X........................................] duration: 2.043294691s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:55:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 2.043316052s core uplink uk-select-1 uk1-placement-17
checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17) antiblip: 2 out of 60 is failed (threshold=3) [.................X..X.......................................] duration: 1.985882816s trace: https://jaeger.dev.storj.io/trace/6e5f903bb3be7402 FAIL (2026-05-25 08:54:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== =212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.777869850 (589h36m48.94998828s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.778373353 (589h36m48.95049179s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780136289 (589h36m48.952254718s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780221745 (589h36m48.952340169s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.780938457 (589h36m48.953056887s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781153190 (589h36m48.953271612s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.781697090 (589h36m48.953815519s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.782568503 (589h36m48.954686932s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.783490531 (589h36m48.955608956s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.784359532 (589h36m48.956477955s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.785213683 (589h36m48.957332114s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786050159 (589h36m48.958168587s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.786971848 (589h36m48.959090275s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:36.787942549 (589h36m48.960060982s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Uploading piece... May 25 08:25:37.248119292 (589h36m49.420237719s) [upload=660137]: Next returned nil segment May 25 08:25:37.248136820 (589h36m49.420255249s) [upload=660137]: Waiting for error group managing segments... May 25 08:25:37.370741062 (589h36m49.542859481s) [noise=true , address=212.102.52.217:4418 , piece_id=USI7UHEWIM7ZR7MEHISOGZEOHHH4IQLKK6IYEIBA4ZDWPDJ5QNIQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.373669449 (589h36m49.545787864s) [noise=true , address=212.102.52.213:4343 , piece_id=6BMDABX5VI43QMK34YYIVOPTDFWEUAOPMRT6ZAE33FGHFFZPHKEA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.379952985 (589h36m49.552071408s) [noise=true , address=212.102.52.215:4377 , piece_id=XU44IP2QFJK3V6EYBPKI6T7KQUP6SYS3JJNCN6BWGCFAIKLC5STQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.380718325 (589h36m49.552836735s) [noise=true , address=212.102.52.217:4425 , piece_id=L6RJR5VJJCDSYXA4BJIURXOONTWXQES7A6L3WVTRKKHOOCWDFF7A, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.381293862 (589h36m49.553412281s) [noise=true , address=212.102.52.217:4439 , piece_id=TESS3CLKQJVSM5KXIAIYIEFPZSODWVY3J2N6GWYZI7NE2OG6PIKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.382698672 (589h36m49.554817088s) [noise=true , address=212.102.52.215:4372 , piece_id=ME7HYFY7HMK4K54VRSWUIZINJVF3QDG6GOCD5YP3K6Z3WDFSEEUQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.383236091 (589h36m49.555354501s) [noise=true , address=212.102.52.213:4344 , piece_id=IXTJJA4YC5JWMAG3JOXBEYZQIKX4Q4NJ55RRNXFCLRIOM6FRUBKQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.388424524 (589h36m49.560542943s) [noise=true , address=212.102.52.213:4335 , piece_id=J4OOE3SQ5ISDZ3FTLJMVCGLUJWGBT2BPJNVPDLXV7SNRXLY2H2LA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.391874773 (589h36m49.563993192s) [noise=true , address=212.102.52.217:4429 , piece_id=J5AB4DV6QIQD5NDDUPRRNHUQ2YQWFMGV537T5VRQP7QZY5QWJJZA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392476300 (589h36m49.564594723s) [noise=true , address=212.102.52.214:4350 , piece_id=6DVMELRL5B5NQYG7D2AWXJWIHT55MWWYEC2JPYA6OQ7W7ZIY3DWA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.392560445 (589h36m49.564678863s) [noise=true , address=212.102.52.214:4360 , piece_id=MUJ5FS3GTNBZSBVK4GQAVD64QTHW5RJPMDG2CQLV2FDWGAQ3T6WQ, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.393662863 (589h36m49.565781287s) [noise=true , address=212.102.52.216:4406 , piece_id=GIA7ZD56Q4PDYXCSUCIFXPOPEX5O7V36CEWVOW4FLSZEC6DTNS4Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.400306392 (589h36m49.572424813s) [noise=true , address=212.102.52.214:4365 , piece_id=4I3VCZKE24MI4N6GURT3O5PZ7LYQI6JTHQTKZIOBWXIFNOAZJ6CA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.402141815 (589h36m49.574260237s) [noise=true , address=212.102.52.214:4356 , piece_id=EM2C7LBWHTOOMP7Y5E2DNBALN7TLTN2N4YK2QEEEEDT57HVBDYAA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404065373 (589h36m49.576183779s) [noise=true , address=212.102.52.215:4373 , piece_id=HYQNFW64KJRPMCOOEOLS5ZI7QCQV6V2PQNWJDAAEQYXL4TMK2DGA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404648569 (589h36m49.576766991s) [noise=true , address=212.102.52.215:4387 , piece_id=2IQNAB26KCNF246T4HFQGDDWQYDBXKHPKC53IG4ZMWAVRYKSOL6Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: <nil> May 25 08:25:37.404661253 (589h36m49.576779672s) [seg_pos={0 0}, upload=660137]: Satisfied cohort requirements after 16 pieces May 25 08:25:37.404888214 (589h36m49.577006643s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fgavD3HvXpxXs2PV5NacdCzKYqkBXv2oLPquUyDFDk7S93brT): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.404897045 (589h36m49.577015476s) [noise=true , address=212.102.52.216:4415 , piece_id=PXAINGR7QQBDTP45GXFRILGB7GIWFNSIDON2ATSMGG43QM2V4PSA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405410065 (589h36m49.577528495s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gBMfaYpfkrDK4PoS6eG2obcjdCJzbLHwLMVXJD1gkZpf5MEPn): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405420334 (589h36m49.577538761s) [noise=true , address=212.102.52.216:4403 , piece_id=C7I6QVLZGPVLJWDPIHFDBNQJKQL6AGJQ2UKUV2LIJP332NUXOK5Q, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405572689 (589h36m49.577691118s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12kyR1KXUXtnrb3DySLDvcXdH7ku1soiwY4DTMyxVmSTGjzoNrs): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405580788 (589h36m49.577699214s) [noise=true , address=212.102.52.216:4401 , piece_id=Z3FUCZYVAFGTGKCK7JVO7SVA463MMCYUJTKPNTIR2ETTE244CTQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405738908 (589h36m49.577857332s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNtJaVKa9A71zjFz4em41XBwKn6jkUpGNCw279Rd7QCfqPL8K): protocol: expected piece hash; context canceled; EOF May 25 08:25:37.405747823 (589h36m49.577866244s) [noise=true , address=212.102.52.213:4342 , piece_id=P2QFNB7B32CRBGKKMQHL4Q4TMONE23NXOQZRQOUBF2KUMTOI3SQA, seg_pos={0 0}, upload=660137]: Long tail cancellation due to optimal threshold May 25 08:25:37.405768627 (589h36m49.577887038s) [seg_pos={0 0}, upload=660137]: Done waiting for segment. successful: 16 optimal: 16 errs: <nil> May 25 08:25:37.405854359 (589h36m49.577972784s) [upload=660137]: Flush batch item: pb.BatchRequestItem_SegmentCommit May 25 08:25:37.405861521 (589h36m49.577979944s) [upload=660137]: Flush batch item: pb.BatchRequestItem_ObjectCommit May 25 08:26:48.014259130 (589h38m0.186377541s) [upload=660137]: Done uploading segments... May 25 08:26:48.014351058 (589h38m0.186469489s) [upload=660137]: Upload finished. err: metaclient: context deadline exceeded Duration: 1.985919511s core uplink uk-select-1 uk1-placement-17

Orbiter Check History

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)

checkers.Uplink{Satellite: "12YKhPHptsaNZY8ksCHkfRkP9TBNdeQmjcRdRSZCiZDwoApAShR@uk1.storj.io:7777", Bucket: "orbiter", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.uk1.placement_17)