Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.....X..X...................................................] duration: 2.083746471s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:14:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.083780899s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [......X..X..................................................] duration: 2.097126388s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:13:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.097174817s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [X......X..X.................................................] duration: 2.105861945s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:13:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.105889431s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [.X......X..X................................................] duration: 2.003795222s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:12:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.003871343s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [..X......X..X...............................................] duration: 2.03265617s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:11:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.032741011s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [...X......X..X..............................................] duration: 2.046923598s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:11:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.046951392s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [....X......X..X.............................................] duration: 2.068168531s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:09:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.06820768s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [.....X......X..X............................................] duration: 2.005918981s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:09:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.005945603s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [......X......X..X...........................................] duration: 1.983640869s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:08:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 1.983670523s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [.......X......X..X..........................................] duration: 2.037046462s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:07:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.037071758s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [........X......X..X.........................................] duration: 2.051200014s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:07:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.051229504s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [.........X......X..X........................................] duration: 2.035516359s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:06:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.035542407s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [..........X......X..X.......................................] duration: 2.066150252s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:05:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.066189485s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [...........X......X..X......................................] duration: 2.069047036s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:04:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.069071453s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [............X......X..X.....................................] duration: 2.06836473s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:03:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.068392374s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [.............X......X..X....................................] duration: 2.028153654s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:02:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.028180047s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [X.............X......X..X...................................] duration: 2.073931428s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:01:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.073944554s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [.X.............X......X..X..................................] duration: 2.063601256s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:01:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.063664222s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [..X.............X......X..X.................................] duration: 2.033044138s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:00:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.033088952s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [...X.............X......X..X................................] duration: 2.03430802s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:59:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.034337808s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [....X.............X......X..X...............................] duration: 2.014639974s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:58:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.014667488s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [.....X.............X......X..X..............................] duration: 2.033156606s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:58:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.03317532s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [......X.............X......X..X.............................] duration: 2.056533278s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:58:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.056556286s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [.......X.............X......X..X............................] duration: 2.027474342s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:57:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.027513257s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [........X.............X......X..X...........................] duration: 2.00585028s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:57:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.005891433s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [.........X.............X......X..X..........................] duration: 2.074579537s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:56:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.074606133s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [..........X.............X......X..X.........................] duration: 1.98906376s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:55:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 1.989089853s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [...........X.............X......X..X........................] duration: 2.025588955s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:54:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.025612567s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [............X.............X......X..X.......................] duration: 2.044847576s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:53:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.044878266s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [.............X.............X......X..X......................] duration: 2.208480936s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:52:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.208505347s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [..............X.............X......X..X.....................] duration: 2.061923926s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:51:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.061955526s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [...............X.............X......X..X....................] duration: 2.457234773s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:51:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.457267138s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [................X.............X......X..X...................] duration: 2.040973378s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:50:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.041002384s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [.................X.............X......X..X..................] duration: 1.97043835s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:49:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 1.970465988s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [..................X.............X......X..X.................] duration: 2.085770427s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:48:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.08579621s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [...................X.............X......X..X................] duration: 2.014337062s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:48:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.014354054s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [....................X.............X......X..X...............] duration: 2.435683281s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:47:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.435708342s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [.....................X.............X......X..X..............] duration: 2.021959601s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:46:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.021982595s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [......................X.............X......X..X.............] duration: 2.024432928s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:46:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.024459313s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [.......................X.............X......X..X............] duration: 2.0914661s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:45:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.09156426s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [........................X.............X......X..X...........] duration: 2.034161259s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:44:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.034186119s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [.........................X.............X......X..X..........] duration: 2.000982744s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:42:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.001004317s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [..........................X.............X......X..X.........] duration: 2.060345293s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:42:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.060372421s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [...........................X.............X......X..X........] duration: 2.015059017s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:42:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.015090297s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [............................X.............X......X..X.......] duration: 2.082239772s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:40:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.08226452s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [.............................X.............X......X..X......] duration: 2.059470166s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:40:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.059495888s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [..............................X.............X......X..X.....] duration: 2.028680775s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:39:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.028703817s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [...............................X.............X......X..X....] duration: 2.066999983s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:38:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.067023555s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [................................X.............X......X..X...] duration: 2.061129346s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:37:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.061156829s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [.................................X.............X......X..X..] duration: 2.259138714s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:37:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.259167527s core uplink eu-select-1 eu1-placement-15

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)