Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [..................................X.............X......X..X.] duration: 2.057413057s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:36:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.057430393s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [...................................X.............X......X..X] duration: 1m0.097697245s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 13:36:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 1m0.097709333s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [....................................X.............X......X..] duration: 2.076969633s trace: https://jaeger.dev.storj.io/trace/4ab7be6617e90b7f FAIL (2025-11-21 13:34:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 5.167.204.205:4013 , piece_id=3ZLKDVG5RKHC2BOWRNVQXCS6T2JZRFB3LJES7GH2GW6NWQTHHG2Q, seg_pos={0 0}, upload=253522]: Uploading piece... Nov 21 13:32:43.384372320 (243h46m8.152055754s) [noise=true , address=185.167.204.206:4046 , piece_id=A2M2B6ZJ3D2DLVOLPC73VW6TNQOEK5ULCGLE4X3FN2IPFU42O5NQ, seg_pos={0 0}, upload=253522]: Uploading piece... Nov 21 13:32:43.384547377 (243h46m8.152230809s) [noise=true , address=81.171.14.70:4030 , piece_id=4ALT5WNMU7M7K7MRJZZ6JSYKIZRODRBZ53XNJYQDQOINQF47IZFQ, seg_pos={0 0}, upload=253522]: Uploading piece... Nov 21 13:32:43.385331150 (243h46m8.153014584s) [noise=true , address=185.167.204.205:4034 , piece_id=633ILUPY6OCHFNRCMAHUWNCZDJXMJRF4X224TEW54OK7BQNQUPWA, seg_pos={0 0}, upload=253522]: Uploading piece... Nov 21 13:32:43.386039847 (243h46m8.153723281s) [noise=true , address=89.149.201.147:4012 , piece_id=MAKOBP3M4JM4USGGLZ7T6PHBHBBAXDVBMIYBZNAF7JO7M2JRN6PA, seg_pos={0 0}, upload=253522]: Uploading piece... Nov 21 13:32:43.386782255 (243h46m8.154465689s) [noise=true , address=185.167.204.206:4038 , piece_id=PIBA6QBZ4NMTXD7DQAQQR7OVB3QPOC42LDSVCGSTOBD64GDO6PUA, seg_pos={0 0}, upload=253522]: Uploading piece... Nov 21 13:32:43.392550322 (243h46m8.16023375s) [noise=true , address=81.171.14.70:4046 , piece_id=K4YPJUVJHKCHWIQXD527HM27VKXOIXYYW7MFUK47L3LIZ37DOJHA, seg_pos={0 0}, upload=253522]: Uploading piece... Nov 21 13:32:43.801777491 (243h46m8.569460905s) [upload=253522]: Next returned nil segment Nov 21 13:32:43.801800508 (243h46m8.569483933s) [upload=253522]: Waiting for error group managing segments... Nov 21 13:32:43.973520448 (243h46m8.741203873s) [noise=true , address=89.149.201.147:4001 , piece_id=FJVVH2IEEHVWS7YIGE3WII6OPDNI7KOQL4MOGGB5ETBW5FAF4VDA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:43.974788804 (243h46m8.742472234s) [noise=true , address=89.149.201.147:4005 , piece_id=VPMEDZEPH77ZSTPHCDVBT3F6QKMEAHFUZTEIGJWZ4VHKWJDAJ2HA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:43.974862480 (243h46m8.742545908s) [noise=true , address=89.149.201.147:4022 , piece_id=CQETOIMWAXJEP5BW26LRGSDL76TF7L5M4CHJZT3HXFKCR5VMW37A, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:43.982538222 (243h46m8.750221648s) [noise=true , address=89.149.201.147:4006 , piece_id=6GRLVK6YTYAEYGKYNAO5FE6KFQYN6R7JPGMAZWBHNVQWYQP44BFA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:43.991727718 (243h46m8.759411143s) [noise=true , address=89.149.201.147:4012 , piece_id=MAKOBP3M4JM4USGGLZ7T6PHBHBBAXDVBMIYBZNAF7JO7M2JRN6PA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:43.994368246 (243h46m8.762051674s) [noise=true , address=185.167.204.206:4038 , piece_id=PIBA6QBZ4NMTXD7DQAQQR7OVB3QPOC42LDSVCGSTOBD64GDO6PUA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:43.994498045 (243h46m8.76218147s) [noise=true , address=185.167.204.206:4040 , piece_id=VZWMXZ2LW7RYN4DHZFMXCUUA3KLXBHKLCGLSQD3OFQLP2BF64GQQ, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:43.995329034 (243h46m8.763012459s) [noise=true , address=185.167.204.205:4027 , piece_id=A5GI2VBBKOP5KFLQWH2GA3WDH7OEF3ZHYZU3VURR3UJBVGU7JDVQ, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:43.998087942 (243h46m8.765771368s) [noise=true , address=185.167.204.205:4009 , piece_id=WLHQXABR3J2ET7UNHSS7I4GOCNX7R6FBC2LIWGIHPVPM6C5X5ELA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.003893709 (243h46m8.771577155s) [noise=true , address=185.167.204.206:4058 , piece_id=LNACDPN7XMXUCPIXLKJOIIRDTMB537XPPR4CLB3EKHRLZYRPDY3Q, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.007711936 (243h46m8.775395393s) [noise=true , address=185.167.204.205:4013 , piece_id=3ZLKDVG5RKHC2BOWRNVQXCS6T2JZRFB3LJES7GH2GW6NWQTHHG2Q, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.009390957 (243h46m8.777074403s) [noise=true , address=185.167.204.205:4023 , piece_id=GKO7CAJWLHEJKKBISF2YS37CIJ5FHJFK6UWQKAAV5GV2OGTCNO2A, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.009528235 (243h46m8.777211672s) [noise=true , address=185.167.204.206:4067 , piece_id=XNWK5ZFVBF3UDVYHN6DKLSJ2WRQWFYUGDWESKLI5I3YGCYMMJIEA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.020787911 (243h46m8.788471336s) [noise=true , address=185.167.204.205:4030 , piece_id=GNR5RYCZSFRV2ZQ27Z5J362MZFLM5EQGFHYP5DAZPGBOWW45LIXA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.029286745 (243h46m8.796970181s) [noise=true , address=185.167.204.206:4046 , piece_id=A2M2B6ZJ3D2DLVOLPC73VW6TNQOEK5ULCGLE4X3FN2IPFU42O5NQ, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.033760271 (243h46m8.801443697s) [noise=true , address=185.167.204.205:4034 , piece_id=633ILUPY6OCHFNRCMAHUWNCZDJXMJRF4X224TEW54OK7BQNQUPWA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.034848893 (243h46m8.802532321s) [noise=true , address=185.167.204.205:4024 , piece_id=74TE3K77BBHS7UTKMOCWASRI6PV3HGDJY7GKU7SJQIK53HZ3AEVQ, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.039225872 (243h46m8.806909297s) [noise=true , address=185.167.204.206:4071 , piece_id=2VEWDCC7ZMDVZCZN3OAQCTZUQO6JL67JJ6EWBIFHPU7PAYHMZXCA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.054078628 (243h46m8.821762053s) [noise=true , address=185.167.204.206:4069 , piece_id=C7EGHSTEFQ2NSOW7FCV4AFJRP7K5XI3IEBDFA65TNVN5GMFGBPOQ, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.059448617 (243h46m8.827132042s) [noise=true , address=185.167.204.205:4017 , piece_id=B4CRNMIYYL63OTFQYSX2VTGM4S2EG4X25YZRXQVWAAJRLEZPTJSQ, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:33:41.972469338 (243h47m6.740152763s) [noise=true , address=81.171.14.70:4032 , piece_id=G2V5TV2YPMSV6BYOUOR2ALK23RD37K2GWJ7BBEYKR7VJGBDYQ2HA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:33:42.707349426 (243h47m7.475032854s) [noise=true , address=81.171.14.70:4043 , piece_id=IWLTW2WJFMSFTQVVA7PC6U6VMARR62ZC6DGXDIFMO234XCPBGHVA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:33:43.013432281 (243h47m7.781115716s) [noise=true , address=81.171.14.70:4047 , piece_id=FIXPZJPGMZCPZHCJVTMLM7S2PS7Z3VCZWUC564SR7MVY72NPCCKQ, seg_pos={0 0}, upload=253522]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: expected piece hash; context deadline exceeded; EOF Nov 21 13:33:43.013644009 (243h47m7.781327435s) [noise=true , address=81.171.14.70:4030 , piece_id=4ALT5WNMU7M7K7MRJZZ6JSYKIZRODRBZ53XNJYQDQOINQF47IZFQ, seg_pos={0 0}, upload=253522]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 159.223.143.39:46570->81.171.14.70:4030: use of closed network connection; write tcp 159.223.143.39:46570->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:46570->81.171.14.70:4030: use of closed network connection Nov 21 13:33:43.013973385 (243h47m7.781656811s) [noise=true , address=81.171.14.70:4046 , piece_id=K4YPJUVJHKCHWIQXD527HM27VKXOIXYYW7MFUK47L3LIZ37DOJHA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 159.223.143.39:43558->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:33:43.014025817 (243h47m7.781709245s) [noise=true , address=81.171.14.70:4044 , piece_id=RSM47QTDOWJEDAUMEJMJ66PLOZ7IJZU7DJDYBHCEUUZTRYR36IBA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: ecclient: upload failed (node:1MUVGecysnTSFcJoHUL7QMWb3h6dtXgUd7FbA672fQCyEWhePr, address:81.171.14.70:4044): protocol: write tcp 159.223.143.39:39144->81.171.14.70:4044: use of closed network connection; write tcp 159.223.143.39:39144->81.171.14.70:4044: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:39144->81.171.14.70:4044: use of closed network connection Nov 21 13:33:43.014240995 (243h47m7.781924421s) [noise=true , address=81.171.14.70:4028 , piece_id=XQF3OOHINKC2EOZ2IC6R2NJY4HBQYFZCM3MTCXYFY7SAP5PTK5SA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: read tcp 159.223.143.39:50054->81.171.14.70:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:33:43.014660964 (243h47m7.782344378s) [noise=true , address=81.171.14.70:4033 , piece_id=YV5MBUPH7OSSQ4FHVS32AJYPRY3IOJ76UAMIPQLJMN3RU573ZXFQ, seg_pos={0 0}, upload=253522]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 159.223.143.39:46834->81.171.14.70:4033: use of closed network connection; write tcp 159.223.143.39:46834->81.171.14.70:4033: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:46834->81.171.14.70:4033: use of closed network connection Nov 21 13:33:43.014689085 (243h47m7.782372501s) [seg_pos={0 0}, upload=253522]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:33:43.117609984 (243h47m7.885293434s) [upload=253522]: Done uploading segments... Nov 21 13:33:43.117647578 (243h47m7.885331003s) [upload=253522]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.076992939s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [.....................................X.............X......X.] duration: 2.035527472s trace: https://jaeger.dev.storj.io/trace/4ab7be6617e90b7f FAIL (2025-11-21 13:33:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 5.167.204.205:4013 , piece_id=3ZLKDVG5RKHC2BOWRNVQXCS6T2JZRFB3LJES7GH2GW6NWQTHHG2Q, seg_pos={0 0}, upload=253522]: Uploading piece... Nov 21 13:32:43.384372320 (243h46m8.152055754s) [noise=true , address=185.167.204.206:4046 , piece_id=A2M2B6ZJ3D2DLVOLPC73VW6TNQOEK5ULCGLE4X3FN2IPFU42O5NQ, seg_pos={0 0}, upload=253522]: Uploading piece... Nov 21 13:32:43.384547377 (243h46m8.152230809s) [noise=true , address=81.171.14.70:4030 , piece_id=4ALT5WNMU7M7K7MRJZZ6JSYKIZRODRBZ53XNJYQDQOINQF47IZFQ, seg_pos={0 0}, upload=253522]: Uploading piece... Nov 21 13:32:43.385331150 (243h46m8.153014584s) [noise=true , address=185.167.204.205:4034 , piece_id=633ILUPY6OCHFNRCMAHUWNCZDJXMJRF4X224TEW54OK7BQNQUPWA, seg_pos={0 0}, upload=253522]: Uploading piece... Nov 21 13:32:43.386039847 (243h46m8.153723281s) [noise=true , address=89.149.201.147:4012 , piece_id=MAKOBP3M4JM4USGGLZ7T6PHBHBBAXDVBMIYBZNAF7JO7M2JRN6PA, seg_pos={0 0}, upload=253522]: Uploading piece... Nov 21 13:32:43.386782255 (243h46m8.154465689s) [noise=true , address=185.167.204.206:4038 , piece_id=PIBA6QBZ4NMTXD7DQAQQR7OVB3QPOC42LDSVCGSTOBD64GDO6PUA, seg_pos={0 0}, upload=253522]: Uploading piece... Nov 21 13:32:43.392550322 (243h46m8.16023375s) [noise=true , address=81.171.14.70:4046 , piece_id=K4YPJUVJHKCHWIQXD527HM27VKXOIXYYW7MFUK47L3LIZ37DOJHA, seg_pos={0 0}, upload=253522]: Uploading piece... Nov 21 13:32:43.801777491 (243h46m8.569460905s) [upload=253522]: Next returned nil segment Nov 21 13:32:43.801800508 (243h46m8.569483933s) [upload=253522]: Waiting for error group managing segments... Nov 21 13:32:43.973520448 (243h46m8.741203873s) [noise=true , address=89.149.201.147:4001 , piece_id=FJVVH2IEEHVWS7YIGE3WII6OPDNI7KOQL4MOGGB5ETBW5FAF4VDA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:43.974788804 (243h46m8.742472234s) [noise=true , address=89.149.201.147:4005 , piece_id=VPMEDZEPH77ZSTPHCDVBT3F6QKMEAHFUZTEIGJWZ4VHKWJDAJ2HA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:43.974862480 (243h46m8.742545908s) [noise=true , address=89.149.201.147:4022 , piece_id=CQETOIMWAXJEP5BW26LRGSDL76TF7L5M4CHJZT3HXFKCR5VMW37A, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:43.982538222 (243h46m8.750221648s) [noise=true , address=89.149.201.147:4006 , piece_id=6GRLVK6YTYAEYGKYNAO5FE6KFQYN6R7JPGMAZWBHNVQWYQP44BFA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:43.991727718 (243h46m8.759411143s) [noise=true , address=89.149.201.147:4012 , piece_id=MAKOBP3M4JM4USGGLZ7T6PHBHBBAXDVBMIYBZNAF7JO7M2JRN6PA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:43.994368246 (243h46m8.762051674s) [noise=true , address=185.167.204.206:4038 , piece_id=PIBA6QBZ4NMTXD7DQAQQR7OVB3QPOC42LDSVCGSTOBD64GDO6PUA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:43.994498045 (243h46m8.76218147s) [noise=true , address=185.167.204.206:4040 , piece_id=VZWMXZ2LW7RYN4DHZFMXCUUA3KLXBHKLCGLSQD3OFQLP2BF64GQQ, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:43.995329034 (243h46m8.763012459s) [noise=true , address=185.167.204.205:4027 , piece_id=A5GI2VBBKOP5KFLQWH2GA3WDH7OEF3ZHYZU3VURR3UJBVGU7JDVQ, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:43.998087942 (243h46m8.765771368s) [noise=true , address=185.167.204.205:4009 , piece_id=WLHQXABR3J2ET7UNHSS7I4GOCNX7R6FBC2LIWGIHPVPM6C5X5ELA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.003893709 (243h46m8.771577155s) [noise=true , address=185.167.204.206:4058 , piece_id=LNACDPN7XMXUCPIXLKJOIIRDTMB537XPPR4CLB3EKHRLZYRPDY3Q, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.007711936 (243h46m8.775395393s) [noise=true , address=185.167.204.205:4013 , piece_id=3ZLKDVG5RKHC2BOWRNVQXCS6T2JZRFB3LJES7GH2GW6NWQTHHG2Q, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.009390957 (243h46m8.777074403s) [noise=true , address=185.167.204.205:4023 , piece_id=GKO7CAJWLHEJKKBISF2YS37CIJ5FHJFK6UWQKAAV5GV2OGTCNO2A, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.009528235 (243h46m8.777211672s) [noise=true , address=185.167.204.206:4067 , piece_id=XNWK5ZFVBF3UDVYHN6DKLSJ2WRQWFYUGDWESKLI5I3YGCYMMJIEA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.020787911 (243h46m8.788471336s) [noise=true , address=185.167.204.205:4030 , piece_id=GNR5RYCZSFRV2ZQ27Z5J362MZFLM5EQGFHYP5DAZPGBOWW45LIXA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.029286745 (243h46m8.796970181s) [noise=true , address=185.167.204.206:4046 , piece_id=A2M2B6ZJ3D2DLVOLPC73VW6TNQOEK5ULCGLE4X3FN2IPFU42O5NQ, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.033760271 (243h46m8.801443697s) [noise=true , address=185.167.204.205:4034 , piece_id=633ILUPY6OCHFNRCMAHUWNCZDJXMJRF4X224TEW54OK7BQNQUPWA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.034848893 (243h46m8.802532321s) [noise=true , address=185.167.204.205:4024 , piece_id=74TE3K77BBHS7UTKMOCWASRI6PV3HGDJY7GKU7SJQIK53HZ3AEVQ, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.039225872 (243h46m8.806909297s) [noise=true , address=185.167.204.206:4071 , piece_id=2VEWDCC7ZMDVZCZN3OAQCTZUQO6JL67JJ6EWBIFHPU7PAYHMZXCA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.054078628 (243h46m8.821762053s) [noise=true , address=185.167.204.206:4069 , piece_id=C7EGHSTEFQ2NSOW7FCV4AFJRP7K5XI3IEBDFA65TNVN5GMFGBPOQ, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.059448617 (243h46m8.827132042s) [noise=true , address=185.167.204.205:4017 , piece_id=B4CRNMIYYL63OTFQYSX2VTGM4S2EG4X25YZRXQVWAAJRLEZPTJSQ, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:33:41.972469338 (243h47m6.740152763s) [noise=true , address=81.171.14.70:4032 , piece_id=G2V5TV2YPMSV6BYOUOR2ALK23RD37K2GWJ7BBEYKR7VJGBDYQ2HA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:33:42.707349426 (243h47m7.475032854s) [noise=true , address=81.171.14.70:4043 , piece_id=IWLTW2WJFMSFTQVVA7PC6U6VMARR62ZC6DGXDIFMO234XCPBGHVA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:33:43.013432281 (243h47m7.781115716s) [noise=true , address=81.171.14.70:4047 , piece_id=FIXPZJPGMZCPZHCJVTMLM7S2PS7Z3VCZWUC564SR7MVY72NPCCKQ, seg_pos={0 0}, upload=253522]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: expected piece hash; context deadline exceeded; EOF Nov 21 13:33:43.013644009 (243h47m7.781327435s) [noise=true , address=81.171.14.70:4030 , piece_id=4ALT5WNMU7M7K7MRJZZ6JSYKIZRODRBZ53XNJYQDQOINQF47IZFQ, seg_pos={0 0}, upload=253522]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 159.223.143.39:46570->81.171.14.70:4030: use of closed network connection; write tcp 159.223.143.39:46570->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:46570->81.171.14.70:4030: use of closed network connection Nov 21 13:33:43.013973385 (243h47m7.781656811s) [noise=true , address=81.171.14.70:4046 , piece_id=K4YPJUVJHKCHWIQXD527HM27VKXOIXYYW7MFUK47L3LIZ37DOJHA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 159.223.143.39:43558->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:33:43.014025817 (243h47m7.781709245s) [noise=true , address=81.171.14.70:4044 , piece_id=RSM47QTDOWJEDAUMEJMJ66PLOZ7IJZU7DJDYBHCEUUZTRYR36IBA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: ecclient: upload failed (node:1MUVGecysnTSFcJoHUL7QMWb3h6dtXgUd7FbA672fQCyEWhePr, address:81.171.14.70:4044): protocol: write tcp 159.223.143.39:39144->81.171.14.70:4044: use of closed network connection; write tcp 159.223.143.39:39144->81.171.14.70:4044: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:39144->81.171.14.70:4044: use of closed network connection Nov 21 13:33:43.014240995 (243h47m7.781924421s) [noise=true , address=81.171.14.70:4028 , piece_id=XQF3OOHINKC2EOZ2IC6R2NJY4HBQYFZCM3MTCXYFY7SAP5PTK5SA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: read tcp 159.223.143.39:50054->81.171.14.70:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:33:43.014660964 (243h47m7.782344378s) [noise=true , address=81.171.14.70:4033 , piece_id=YV5MBUPH7OSSQ4FHVS32AJYPRY3IOJ76UAMIPQLJMN3RU573ZXFQ, seg_pos={0 0}, upload=253522]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 159.223.143.39:46834->81.171.14.70:4033: use of closed network connection; write tcp 159.223.143.39:46834->81.171.14.70:4033: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:46834->81.171.14.70:4033: use of closed network connection Nov 21 13:33:43.014689085 (243h47m7.782372501s) [seg_pos={0 0}, upload=253522]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:33:43.117609984 (243h47m7.885293434s) [upload=253522]: Done uploading segments... Nov 21 13:33:43.117647578 (243h47m7.885331003s) [upload=253522]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.035546095s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [......................................X.............X......X] duration: 1m0.108026706s trace: https://jaeger.dev.storj.io/trace/4ab7be6617e90b7f FAIL (2025-11-21 13:33:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 5.167.204.205:4013 , piece_id=3ZLKDVG5RKHC2BOWRNVQXCS6T2JZRFB3LJES7GH2GW6NWQTHHG2Q, seg_pos={0 0}, upload=253522]: Uploading piece... Nov 21 13:32:43.384372320 (243h46m8.152055754s) [noise=true , address=185.167.204.206:4046 , piece_id=A2M2B6ZJ3D2DLVOLPC73VW6TNQOEK5ULCGLE4X3FN2IPFU42O5NQ, seg_pos={0 0}, upload=253522]: Uploading piece... Nov 21 13:32:43.384547377 (243h46m8.152230809s) [noise=true , address=81.171.14.70:4030 , piece_id=4ALT5WNMU7M7K7MRJZZ6JSYKIZRODRBZ53XNJYQDQOINQF47IZFQ, seg_pos={0 0}, upload=253522]: Uploading piece... Nov 21 13:32:43.385331150 (243h46m8.153014584s) [noise=true , address=185.167.204.205:4034 , piece_id=633ILUPY6OCHFNRCMAHUWNCZDJXMJRF4X224TEW54OK7BQNQUPWA, seg_pos={0 0}, upload=253522]: Uploading piece... Nov 21 13:32:43.386039847 (243h46m8.153723281s) [noise=true , address=89.149.201.147:4012 , piece_id=MAKOBP3M4JM4USGGLZ7T6PHBHBBAXDVBMIYBZNAF7JO7M2JRN6PA, seg_pos={0 0}, upload=253522]: Uploading piece... Nov 21 13:32:43.386782255 (243h46m8.154465689s) [noise=true , address=185.167.204.206:4038 , piece_id=PIBA6QBZ4NMTXD7DQAQQR7OVB3QPOC42LDSVCGSTOBD64GDO6PUA, seg_pos={0 0}, upload=253522]: Uploading piece... Nov 21 13:32:43.392550322 (243h46m8.16023375s) [noise=true , address=81.171.14.70:4046 , piece_id=K4YPJUVJHKCHWIQXD527HM27VKXOIXYYW7MFUK47L3LIZ37DOJHA, seg_pos={0 0}, upload=253522]: Uploading piece... Nov 21 13:32:43.801777491 (243h46m8.569460905s) [upload=253522]: Next returned nil segment Nov 21 13:32:43.801800508 (243h46m8.569483933s) [upload=253522]: Waiting for error group managing segments... Nov 21 13:32:43.973520448 (243h46m8.741203873s) [noise=true , address=89.149.201.147:4001 , piece_id=FJVVH2IEEHVWS7YIGE3WII6OPDNI7KOQL4MOGGB5ETBW5FAF4VDA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:43.974788804 (243h46m8.742472234s) [noise=true , address=89.149.201.147:4005 , piece_id=VPMEDZEPH77ZSTPHCDVBT3F6QKMEAHFUZTEIGJWZ4VHKWJDAJ2HA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:43.974862480 (243h46m8.742545908s) [noise=true , address=89.149.201.147:4022 , piece_id=CQETOIMWAXJEP5BW26LRGSDL76TF7L5M4CHJZT3HXFKCR5VMW37A, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:43.982538222 (243h46m8.750221648s) [noise=true , address=89.149.201.147:4006 , piece_id=6GRLVK6YTYAEYGKYNAO5FE6KFQYN6R7JPGMAZWBHNVQWYQP44BFA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:43.991727718 (243h46m8.759411143s) [noise=true , address=89.149.201.147:4012 , piece_id=MAKOBP3M4JM4USGGLZ7T6PHBHBBAXDVBMIYBZNAF7JO7M2JRN6PA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:43.994368246 (243h46m8.762051674s) [noise=true , address=185.167.204.206:4038 , piece_id=PIBA6QBZ4NMTXD7DQAQQR7OVB3QPOC42LDSVCGSTOBD64GDO6PUA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:43.994498045 (243h46m8.76218147s) [noise=true , address=185.167.204.206:4040 , piece_id=VZWMXZ2LW7RYN4DHZFMXCUUA3KLXBHKLCGLSQD3OFQLP2BF64GQQ, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:43.995329034 (243h46m8.763012459s) [noise=true , address=185.167.204.205:4027 , piece_id=A5GI2VBBKOP5KFLQWH2GA3WDH7OEF3ZHYZU3VURR3UJBVGU7JDVQ, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:43.998087942 (243h46m8.765771368s) [noise=true , address=185.167.204.205:4009 , piece_id=WLHQXABR3J2ET7UNHSS7I4GOCNX7R6FBC2LIWGIHPVPM6C5X5ELA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.003893709 (243h46m8.771577155s) [noise=true , address=185.167.204.206:4058 , piece_id=LNACDPN7XMXUCPIXLKJOIIRDTMB537XPPR4CLB3EKHRLZYRPDY3Q, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.007711936 (243h46m8.775395393s) [noise=true , address=185.167.204.205:4013 , piece_id=3ZLKDVG5RKHC2BOWRNVQXCS6T2JZRFB3LJES7GH2GW6NWQTHHG2Q, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.009390957 (243h46m8.777074403s) [noise=true , address=185.167.204.205:4023 , piece_id=GKO7CAJWLHEJKKBISF2YS37CIJ5FHJFK6UWQKAAV5GV2OGTCNO2A, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.009528235 (243h46m8.777211672s) [noise=true , address=185.167.204.206:4067 , piece_id=XNWK5ZFVBF3UDVYHN6DKLSJ2WRQWFYUGDWESKLI5I3YGCYMMJIEA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.020787911 (243h46m8.788471336s) [noise=true , address=185.167.204.205:4030 , piece_id=GNR5RYCZSFRV2ZQ27Z5J362MZFLM5EQGFHYP5DAZPGBOWW45LIXA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.029286745 (243h46m8.796970181s) [noise=true , address=185.167.204.206:4046 , piece_id=A2M2B6ZJ3D2DLVOLPC73VW6TNQOEK5ULCGLE4X3FN2IPFU42O5NQ, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.033760271 (243h46m8.801443697s) [noise=true , address=185.167.204.205:4034 , piece_id=633ILUPY6OCHFNRCMAHUWNCZDJXMJRF4X224TEW54OK7BQNQUPWA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.034848893 (243h46m8.802532321s) [noise=true , address=185.167.204.205:4024 , piece_id=74TE3K77BBHS7UTKMOCWASRI6PV3HGDJY7GKU7SJQIK53HZ3AEVQ, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.039225872 (243h46m8.806909297s) [noise=true , address=185.167.204.206:4071 , piece_id=2VEWDCC7ZMDVZCZN3OAQCTZUQO6JL67JJ6EWBIFHPU7PAYHMZXCA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.054078628 (243h46m8.821762053s) [noise=true , address=185.167.204.206:4069 , piece_id=C7EGHSTEFQ2NSOW7FCV4AFJRP7K5XI3IEBDFA65TNVN5GMFGBPOQ, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:32:44.059448617 (243h46m8.827132042s) [noise=true , address=185.167.204.205:4017 , piece_id=B4CRNMIYYL63OTFQYSX2VTGM4S2EG4X25YZRXQVWAAJRLEZPTJSQ, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:33:41.972469338 (243h47m6.740152763s) [noise=true , address=81.171.14.70:4032 , piece_id=G2V5TV2YPMSV6BYOUOR2ALK23RD37K2GWJ7BBEYKR7VJGBDYQ2HA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:33:42.707349426 (243h47m7.475032854s) [noise=true , address=81.171.14.70:4043 , piece_id=IWLTW2WJFMSFTQVVA7PC6U6VMARR62ZC6DGXDIFMO234XCPBGHVA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: <nil> Nov 21 13:33:43.013432281 (243h47m7.781115716s) [noise=true , address=81.171.14.70:4047 , piece_id=FIXPZJPGMZCPZHCJVTMLM7S2PS7Z3VCZWUC564SR7MVY72NPCCKQ, seg_pos={0 0}, upload=253522]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: expected piece hash; context deadline exceeded; EOF Nov 21 13:33:43.013644009 (243h47m7.781327435s) [noise=true , address=81.171.14.70:4030 , piece_id=4ALT5WNMU7M7K7MRJZZ6JSYKIZRODRBZ53XNJYQDQOINQF47IZFQ, seg_pos={0 0}, upload=253522]: Done uploading piece. err: ecclient: upload failed (node:12ZoRwa8wLw66Pjumy1ybp6wrZ79RrSU55uYZpwaY3xi95iSYde, address:81.171.14.70:4030): protocol: write tcp 159.223.143.39:46570->81.171.14.70:4030: use of closed network connection; write tcp 159.223.143.39:46570->81.171.14.70:4030: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:46570->81.171.14.70:4030: use of closed network connection Nov 21 13:33:43.013973385 (243h47m7.781656811s) [noise=true , address=81.171.14.70:4046 , piece_id=K4YPJUVJHKCHWIQXD527HM27VKXOIXYYW7MFUK47L3LIZ37DOJHA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: read tcp 159.223.143.39:43558->81.171.14.70:4046: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:33:43.014025817 (243h47m7.781709245s) [noise=true , address=81.171.14.70:4044 , piece_id=RSM47QTDOWJEDAUMEJMJ66PLOZ7IJZU7DJDYBHCEUUZTRYR36IBA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: ecclient: upload failed (node:1MUVGecysnTSFcJoHUL7QMWb3h6dtXgUd7FbA672fQCyEWhePr, address:81.171.14.70:4044): protocol: write tcp 159.223.143.39:39144->81.171.14.70:4044: use of closed network connection; write tcp 159.223.143.39:39144->81.171.14.70:4044: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:39144->81.171.14.70:4044: use of closed network connection Nov 21 13:33:43.014240995 (243h47m7.781924421s) [noise=true , address=81.171.14.70:4028 , piece_id=XQF3OOHINKC2EOZ2IC6R2NJY4HBQYFZCM3MTCXYFY7SAP5PTK5SA, seg_pos={0 0}, upload=253522]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: read tcp 159.223.143.39:50054->81.171.14.70:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:33:43.014660964 (243h47m7.782344378s) [noise=true , address=81.171.14.70:4033 , piece_id=YV5MBUPH7OSSQ4FHVS32AJYPRY3IOJ76UAMIPQLJMN3RU573ZXFQ, seg_pos={0 0}, upload=253522]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: write tcp 159.223.143.39:46834->81.171.14.70:4033: use of closed network connection; write tcp 159.223.143.39:46834->81.171.14.70:4033: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:46834->81.171.14.70:4033: use of closed network connection Nov 21 13:33:43.014689085 (243h47m7.782372501s) [seg_pos={0 0}, upload=253522]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:33:43.117609984 (243h47m7.885293434s) [upload=253522]: Done uploading segments... Nov 21 13:33:43.117647578 (243h47m7.885331003s) [upload=253522]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 1m0.108047173s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X.............X......] duration: 2.068933559s trace: https://jaeger.dev.storj.io/trace/47811fe2fbaa96eb FAIL (2025-11-21 13:32:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== 4024 , piece_id=A6VFSY5DRWHUYR2ZTJWSKOCUKA6PIP5EIX3HLKXEKFEOEEZKEYXQ, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.456744444 (243h40m41.224427869s) [noise=true , address=185.167.204.205:4009 , piece_id=OAWIL6OKSUNVDVZCPGXFJJMVM5N2LBRGF6GOZRVMK3UDAU3HDYYA, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.457344616 (243h40m41.225028049s) [noise=true , address=81.171.14.70:4041 , piece_id=P4T5LKLZ4DGJEPS6KUKEZMIPJ77T2EGZEU6BM5NTEBSMTTKZZPKQ, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.457944980 (243h40m41.225628412s) [noise=true , address=81.171.14.70:4042 , piece_id=BDFTS6NXJLGUXBG6SWMCR2UK6L5REBFBWGBB2TMJFLJQKL37U53Q, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.458830101 (243h40m41.226513532s) [noise=true , address=89.149.201.147:4003 , piece_id=QILBUGFQ6WMNOI2FAZTEVWREPQGMI27LNQ2QI5AORZZRDZZ3K7YA, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.459239982 (243h40m41.226923419s) [noise=true , address=81.171.14.70:4046 , piece_id=ADRWKWGHKDFTSTNZOM4V2UNRHVRBX6IXWAPPPW5DSXQYQN3ZRI4A, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.459918472 (243h40m41.227601907s) [noise=true , address=81.171.14.70:4028 , piece_id=AK2CWOZIXSHPD2CXDBYDDOK5PM35Q4VUXRCJRDYL5YILIPIW3ZNA, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.460546153 (243h40m41.228229587s) [noise=true , address=89.149.201.147:4009 , piece_id=5ZEI7EYCVNCOC2AHFPFXGUO42PMO446WNDGD4JC5RAR5AQ4D4ONA, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.461289352 (243h40m41.22897278s) [noise=true , address=185.167.204.205:4028 , piece_id=KTSAZC72EG4W4CQD2G4ZLAWGZXLRRQ2FDGT6HQC3AG3ASIPX7PIQ, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.461661307 (243h40m41.229344739s) [noise=true , address=81.171.14.70:4032 , piece_id=PLOMGVUNJBQYBVA4RWCYNRGMRCF5CRMS6SCXIG3HKASRA4VNAE7A, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:17.334210248 (243h40m42.101893673s) [upload=253421]: Next returned nil segment Nov 21 13:27:17.334234298 (243h40m42.101917722s) [upload=253421]: Waiting for error group managing segments... Nov 21 13:27:18.519937220 (243h40m43.287620646s) [noise=true , address=89.149.201.147:4016 , piece_id=DKIXZHH6GBTI6ZIFKYBVRA6WW4UP4NWJ7IVH2DIPOUCIWYUXFOLQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:18.830542349 (243h40m43.598225774s) [noise=true , address=89.149.201.147:4009 , piece_id=5ZEI7EYCVNCOC2AHFPFXGUO42PMO446WNDGD4JC5RAR5AQ4D4ONA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:19.412300923 (243h40m44.17998434s) [noise=true , address=89.149.201.147:4024 , piece_id=A6VFSY5DRWHUYR2ZTJWSKOCUKA6PIP5EIX3HLKXEKFEOEEZKEYXQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:19.841290059 (243h40m44.608973472s) [noise=true , address=89.149.201.147:4008 , piece_id=GJS7LWBXBYJ466E4W3SH5PH72OSGKWE3YHYIZTQ4SSAVYB6EBEUQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:20.173455422 (243h40m44.941138847s) [noise=true , address=89.149.201.147:4023 , piece_id=DRYK3HOGN2TUHZUXG2KR53U2KDFNW3WOWIQPFKOADK7XD4UMYYPQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:20.245445825 (243h40m45.013129261s) [noise=true , address=89.149.201.147:4001 , piece_id=4PP5KWKQWYJCTTLLG3ZQPVE44ZAVWQDEK4DWBOKVNW4WI6E4OKMA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:22.191180405 (243h40m46.958863841s) [noise=true , address=89.149.201.147:4003 , piece_id=QILBUGFQ6WMNOI2FAZTEVWREPQGMI27LNQ2QI5AORZZRDZZ3K7YA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:22.583267895 (243h40m47.35095132s) [noise=true , address=185.167.204.205:4017 , piece_id=X7X47GAFTY6JIQ4HAP364ABBY2TF5V7EPGNZG6J57BMIUWOSPRBA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:24.810390053 (243h40m49.578073479s) [noise=true , address=185.167.204.206:4052 , piece_id=C7WFPIJVOM6C5GKXLNGIOMH6ZAZGGAY7R6THAKB7TLVWBHSWOT6Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:25.641179406 (243h40m50.408862832s) [noise=true , address=185.167.204.205:4015 , piece_id=KF2ENYHUIBVXDGYJ7HCK262MMIGKN3TXDYALX3RYXN7WKKUSDE4A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:25.997384028 (243h40m50.765067456s) [noise=true , address=185.167.204.205:4006 , piece_id=RNHU3X5ELFCOE4FMB2ZJZHBTSWWNPL66BGB7STLGIF6OM7AUCJ7Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:27.585033675 (243h40m52.3527171s) [noise=true , address=89.149.201.147:4002 , piece_id=3MILEDK2IJFOA5I5CTHRHXHH6TBHCK4PBEECT6PSJ2NGUYCHHEWA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:28.545851979 (243h40m53.313535413s) [noise=true , address=185.167.204.205:4024 , piece_id=HKUZDC63JZTO4X74XZQPYCDEI3QHSSZFKEV6SEMKE5OWBL55RW7A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:30.131680481 (243h40m54.899363911s) [noise=true , address=89.149.201.147:4017 , piece_id=J6XPZTMH73W4J2VH34QC4D4575ZLMPARNH6OZD53WO2SLDBUPIXA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:38.128354246 (243h41m2.896037676s) [noise=true , address=185.167.204.206:4045 , piece_id=TLAXGL5WA553KJ6ODOAIH4ZN3WBBTXT2VWTHMEQIN77MXPY24LAA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:41.974219207 (243h41m6.74190262s) [noise=true , address=185.167.204.205:4009 , piece_id=OAWIL6OKSUNVDVZCPGXFJJMVM5N2LBRGF6GOZRVMK3UDAU3HDYYA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:42.357309370 (243h41m7.124992795s) [noise=true , address=185.167.204.205:4033 , piece_id=BFLYT6HD3XUX7SVZ7I5LZDOHTWCG4LEQBGNHUBOPU6KZRK5F4P4A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:54.968735050 (243h41m19.736418465s) [noise=true , address=185.167.204.205:4026 , piece_id=W2IIMQXQLPCYJQPSEBR7NO5U6F3XL4CKL66WMAJDEVR4KAOTP3WQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:08.832186582 (243h41m33.599870007s) [noise=true , address=81.171.14.70:4041 , piece_id=P4T5LKLZ4DGJEPS6KUKEZMIPJ77T2EGZEU6BM5NTEBSMTTKZZPKQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:09.432091332 (243h41m34.199774758s) [noise=true , address=81.171.14.70:4035 , piece_id=XGCREFPMPTINYW7QX3T4W5HF7GTZSUZ77N4KAYT3OYUWLCUSJC2Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:10.126748502 (243h41m34.894431914s) [noise=true , address=81.171.14.70:4030 , piece_id=3Y2VUW6MIXLDXOZPHFEWSZNEJ2CZJVS5JRPMUZG5KBC3VHAKU5CA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:10.955637497 (243h41m35.723320923s) [noise=true , address=81.171.14.70:4042 , piece_id=BDFTS6NXJLGUXBG6SWMCR2UK6L5REBFBWGBB2TMJFLJQKL37U53Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:11.831525196 (243h41m36.599208624s) [noise=true , address=81.171.14.70:4032 , piece_id=PLOMGVUNJBQYBVA4RWCYNRGMRCF5CRMS6SCXIG3HKASRA4VNAE7A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:16.062589282 (243h41m40.83027271s) [noise=true , address=81.171.14.70:4028 , piece_id=AK2CWOZIXSHPD2CXDBYDDOK5PM35Q4VUXRCJRDYL5YILIPIW3ZNA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: read tcp 159.223.143.39:55578->81.171.14.70:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.062759086 (243h41m40.830442517s) [noise=true , address=81.171.14.70:4046 , piece_id=ADRWKWGHKDFTSTNZOM4V2UNRHVRBX6IXWAPPPW5DSXQYQN3ZRI4A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: rpc: dial tcp 81.171.14.70:4046: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.063010482 (243h41m40.830693913s) [noise=true , address=81.171.14.70:4027 , piece_id=LQG6OQ2C37PWRAEFMLZWIOIEGTVP25RYIOK4H64YSPGT32FMDW6Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 159.223.143.39:38588->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.063157039 (243h41m40.830840474s) [noise=true , address=185.167.204.205:4004 , piece_id=653KFRZJSTM6GESRAF2L4NCUMB7E54PG52A6OOPNKPP7JUAFBNWA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.063355188 (243h41m40.831038616s) [noise=true , address=185.167.204.205:4028 , piece_id=KTSAZC72EG4W4CQD2G4ZLAWGZXLRRQ2FDGT6HQC3AG3ASIPX7PIQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: write tcp 159.223.143.39:33488->185.167.204.205:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.063385546 (243h41m40.831068972s) [seg_pos={0 0}, upload=253421]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 21 13:28:16.157185589 (243h41m40.924869014s) [upload=253421]: Done uploading segments... Nov 21 13:28:16.157220987 (243h41m40.924904412s) [upload=253421]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 2.068977361s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [........................................X.............X.....] duration: 2.509931183s trace: https://jaeger.dev.storj.io/trace/47811fe2fbaa96eb FAIL (2025-11-21 13:30:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== 4024 , piece_id=A6VFSY5DRWHUYR2ZTJWSKOCUKA6PIP5EIX3HLKXEKFEOEEZKEYXQ, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.456744444 (243h40m41.224427869s) [noise=true , address=185.167.204.205:4009 , piece_id=OAWIL6OKSUNVDVZCPGXFJJMVM5N2LBRGF6GOZRVMK3UDAU3HDYYA, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.457344616 (243h40m41.225028049s) [noise=true , address=81.171.14.70:4041 , piece_id=P4T5LKLZ4DGJEPS6KUKEZMIPJ77T2EGZEU6BM5NTEBSMTTKZZPKQ, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.457944980 (243h40m41.225628412s) [noise=true , address=81.171.14.70:4042 , piece_id=BDFTS6NXJLGUXBG6SWMCR2UK6L5REBFBWGBB2TMJFLJQKL37U53Q, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.458830101 (243h40m41.226513532s) [noise=true , address=89.149.201.147:4003 , piece_id=QILBUGFQ6WMNOI2FAZTEVWREPQGMI27LNQ2QI5AORZZRDZZ3K7YA, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.459239982 (243h40m41.226923419s) [noise=true , address=81.171.14.70:4046 , piece_id=ADRWKWGHKDFTSTNZOM4V2UNRHVRBX6IXWAPPPW5DSXQYQN3ZRI4A, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.459918472 (243h40m41.227601907s) [noise=true , address=81.171.14.70:4028 , piece_id=AK2CWOZIXSHPD2CXDBYDDOK5PM35Q4VUXRCJRDYL5YILIPIW3ZNA, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.460546153 (243h40m41.228229587s) [noise=true , address=89.149.201.147:4009 , piece_id=5ZEI7EYCVNCOC2AHFPFXGUO42PMO446WNDGD4JC5RAR5AQ4D4ONA, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.461289352 (243h40m41.22897278s) [noise=true , address=185.167.204.205:4028 , piece_id=KTSAZC72EG4W4CQD2G4ZLAWGZXLRRQ2FDGT6HQC3AG3ASIPX7PIQ, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.461661307 (243h40m41.229344739s) [noise=true , address=81.171.14.70:4032 , piece_id=PLOMGVUNJBQYBVA4RWCYNRGMRCF5CRMS6SCXIG3HKASRA4VNAE7A, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:17.334210248 (243h40m42.101893673s) [upload=253421]: Next returned nil segment Nov 21 13:27:17.334234298 (243h40m42.101917722s) [upload=253421]: Waiting for error group managing segments... Nov 21 13:27:18.519937220 (243h40m43.287620646s) [noise=true , address=89.149.201.147:4016 , piece_id=DKIXZHH6GBTI6ZIFKYBVRA6WW4UP4NWJ7IVH2DIPOUCIWYUXFOLQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:18.830542349 (243h40m43.598225774s) [noise=true , address=89.149.201.147:4009 , piece_id=5ZEI7EYCVNCOC2AHFPFXGUO42PMO446WNDGD4JC5RAR5AQ4D4ONA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:19.412300923 (243h40m44.17998434s) [noise=true , address=89.149.201.147:4024 , piece_id=A6VFSY5DRWHUYR2ZTJWSKOCUKA6PIP5EIX3HLKXEKFEOEEZKEYXQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:19.841290059 (243h40m44.608973472s) [noise=true , address=89.149.201.147:4008 , piece_id=GJS7LWBXBYJ466E4W3SH5PH72OSGKWE3YHYIZTQ4SSAVYB6EBEUQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:20.173455422 (243h40m44.941138847s) [noise=true , address=89.149.201.147:4023 , piece_id=DRYK3HOGN2TUHZUXG2KR53U2KDFNW3WOWIQPFKOADK7XD4UMYYPQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:20.245445825 (243h40m45.013129261s) [noise=true , address=89.149.201.147:4001 , piece_id=4PP5KWKQWYJCTTLLG3ZQPVE44ZAVWQDEK4DWBOKVNW4WI6E4OKMA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:22.191180405 (243h40m46.958863841s) [noise=true , address=89.149.201.147:4003 , piece_id=QILBUGFQ6WMNOI2FAZTEVWREPQGMI27LNQ2QI5AORZZRDZZ3K7YA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:22.583267895 (243h40m47.35095132s) [noise=true , address=185.167.204.205:4017 , piece_id=X7X47GAFTY6JIQ4HAP364ABBY2TF5V7EPGNZG6J57BMIUWOSPRBA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:24.810390053 (243h40m49.578073479s) [noise=true , address=185.167.204.206:4052 , piece_id=C7WFPIJVOM6C5GKXLNGIOMH6ZAZGGAY7R6THAKB7TLVWBHSWOT6Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:25.641179406 (243h40m50.408862832s) [noise=true , address=185.167.204.205:4015 , piece_id=KF2ENYHUIBVXDGYJ7HCK262MMIGKN3TXDYALX3RYXN7WKKUSDE4A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:25.997384028 (243h40m50.765067456s) [noise=true , address=185.167.204.205:4006 , piece_id=RNHU3X5ELFCOE4FMB2ZJZHBTSWWNPL66BGB7STLGIF6OM7AUCJ7Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:27.585033675 (243h40m52.3527171s) [noise=true , address=89.149.201.147:4002 , piece_id=3MILEDK2IJFOA5I5CTHRHXHH6TBHCK4PBEECT6PSJ2NGUYCHHEWA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:28.545851979 (243h40m53.313535413s) [noise=true , address=185.167.204.205:4024 , piece_id=HKUZDC63JZTO4X74XZQPYCDEI3QHSSZFKEV6SEMKE5OWBL55RW7A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:30.131680481 (243h40m54.899363911s) [noise=true , address=89.149.201.147:4017 , piece_id=J6XPZTMH73W4J2VH34QC4D4575ZLMPARNH6OZD53WO2SLDBUPIXA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:38.128354246 (243h41m2.896037676s) [noise=true , address=185.167.204.206:4045 , piece_id=TLAXGL5WA553KJ6ODOAIH4ZN3WBBTXT2VWTHMEQIN77MXPY24LAA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:41.974219207 (243h41m6.74190262s) [noise=true , address=185.167.204.205:4009 , piece_id=OAWIL6OKSUNVDVZCPGXFJJMVM5N2LBRGF6GOZRVMK3UDAU3HDYYA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:42.357309370 (243h41m7.124992795s) [noise=true , address=185.167.204.205:4033 , piece_id=BFLYT6HD3XUX7SVZ7I5LZDOHTWCG4LEQBGNHUBOPU6KZRK5F4P4A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:54.968735050 (243h41m19.736418465s) [noise=true , address=185.167.204.205:4026 , piece_id=W2IIMQXQLPCYJQPSEBR7NO5U6F3XL4CKL66WMAJDEVR4KAOTP3WQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:08.832186582 (243h41m33.599870007s) [noise=true , address=81.171.14.70:4041 , piece_id=P4T5LKLZ4DGJEPS6KUKEZMIPJ77T2EGZEU6BM5NTEBSMTTKZZPKQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:09.432091332 (243h41m34.199774758s) [noise=true , address=81.171.14.70:4035 , piece_id=XGCREFPMPTINYW7QX3T4W5HF7GTZSUZ77N4KAYT3OYUWLCUSJC2Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:10.126748502 (243h41m34.894431914s) [noise=true , address=81.171.14.70:4030 , piece_id=3Y2VUW6MIXLDXOZPHFEWSZNEJ2CZJVS5JRPMUZG5KBC3VHAKU5CA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:10.955637497 (243h41m35.723320923s) [noise=true , address=81.171.14.70:4042 , piece_id=BDFTS6NXJLGUXBG6SWMCR2UK6L5REBFBWGBB2TMJFLJQKL37U53Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:11.831525196 (243h41m36.599208624s) [noise=true , address=81.171.14.70:4032 , piece_id=PLOMGVUNJBQYBVA4RWCYNRGMRCF5CRMS6SCXIG3HKASRA4VNAE7A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:16.062589282 (243h41m40.83027271s) [noise=true , address=81.171.14.70:4028 , piece_id=AK2CWOZIXSHPD2CXDBYDDOK5PM35Q4VUXRCJRDYL5YILIPIW3ZNA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: read tcp 159.223.143.39:55578->81.171.14.70:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.062759086 (243h41m40.830442517s) [noise=true , address=81.171.14.70:4046 , piece_id=ADRWKWGHKDFTSTNZOM4V2UNRHVRBX6IXWAPPPW5DSXQYQN3ZRI4A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: rpc: dial tcp 81.171.14.70:4046: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.063010482 (243h41m40.830693913s) [noise=true , address=81.171.14.70:4027 , piece_id=LQG6OQ2C37PWRAEFMLZWIOIEGTVP25RYIOK4H64YSPGT32FMDW6Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 159.223.143.39:38588->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.063157039 (243h41m40.830840474s) [noise=true , address=185.167.204.205:4004 , piece_id=653KFRZJSTM6GESRAF2L4NCUMB7E54PG52A6OOPNKPP7JUAFBNWA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.063355188 (243h41m40.831038616s) [noise=true , address=185.167.204.205:4028 , piece_id=KTSAZC72EG4W4CQD2G4ZLAWGZXLRRQ2FDGT6HQC3AG3ASIPX7PIQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: write tcp 159.223.143.39:33488->185.167.204.205:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.063385546 (243h41m40.831068972s) [seg_pos={0 0}, upload=253421]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 21 13:28:16.157185589 (243h41m40.924869014s) [upload=253421]: Done uploading segments... Nov 21 13:28:16.157220987 (243h41m40.924904412s) [upload=253421]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 2.509959439s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X.............X....] duration: 2.439764638s trace: https://jaeger.dev.storj.io/trace/47811fe2fbaa96eb FAIL (2025-11-21 13:29:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== 4024 , piece_id=A6VFSY5DRWHUYR2ZTJWSKOCUKA6PIP5EIX3HLKXEKFEOEEZKEYXQ, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.456744444 (243h40m41.224427869s) [noise=true , address=185.167.204.205:4009 , piece_id=OAWIL6OKSUNVDVZCPGXFJJMVM5N2LBRGF6GOZRVMK3UDAU3HDYYA, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.457344616 (243h40m41.225028049s) [noise=true , address=81.171.14.70:4041 , piece_id=P4T5LKLZ4DGJEPS6KUKEZMIPJ77T2EGZEU6BM5NTEBSMTTKZZPKQ, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.457944980 (243h40m41.225628412s) [noise=true , address=81.171.14.70:4042 , piece_id=BDFTS6NXJLGUXBG6SWMCR2UK6L5REBFBWGBB2TMJFLJQKL37U53Q, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.458830101 (243h40m41.226513532s) [noise=true , address=89.149.201.147:4003 , piece_id=QILBUGFQ6WMNOI2FAZTEVWREPQGMI27LNQ2QI5AORZZRDZZ3K7YA, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.459239982 (243h40m41.226923419s) [noise=true , address=81.171.14.70:4046 , piece_id=ADRWKWGHKDFTSTNZOM4V2UNRHVRBX6IXWAPPPW5DSXQYQN3ZRI4A, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.459918472 (243h40m41.227601907s) [noise=true , address=81.171.14.70:4028 , piece_id=AK2CWOZIXSHPD2CXDBYDDOK5PM35Q4VUXRCJRDYL5YILIPIW3ZNA, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.460546153 (243h40m41.228229587s) [noise=true , address=89.149.201.147:4009 , piece_id=5ZEI7EYCVNCOC2AHFPFXGUO42PMO446WNDGD4JC5RAR5AQ4D4ONA, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.461289352 (243h40m41.22897278s) [noise=true , address=185.167.204.205:4028 , piece_id=KTSAZC72EG4W4CQD2G4ZLAWGZXLRRQ2FDGT6HQC3AG3ASIPX7PIQ, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.461661307 (243h40m41.229344739s) [noise=true , address=81.171.14.70:4032 , piece_id=PLOMGVUNJBQYBVA4RWCYNRGMRCF5CRMS6SCXIG3HKASRA4VNAE7A, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:17.334210248 (243h40m42.101893673s) [upload=253421]: Next returned nil segment Nov 21 13:27:17.334234298 (243h40m42.101917722s) [upload=253421]: Waiting for error group managing segments... Nov 21 13:27:18.519937220 (243h40m43.287620646s) [noise=true , address=89.149.201.147:4016 , piece_id=DKIXZHH6GBTI6ZIFKYBVRA6WW4UP4NWJ7IVH2DIPOUCIWYUXFOLQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:18.830542349 (243h40m43.598225774s) [noise=true , address=89.149.201.147:4009 , piece_id=5ZEI7EYCVNCOC2AHFPFXGUO42PMO446WNDGD4JC5RAR5AQ4D4ONA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:19.412300923 (243h40m44.17998434s) [noise=true , address=89.149.201.147:4024 , piece_id=A6VFSY5DRWHUYR2ZTJWSKOCUKA6PIP5EIX3HLKXEKFEOEEZKEYXQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:19.841290059 (243h40m44.608973472s) [noise=true , address=89.149.201.147:4008 , piece_id=GJS7LWBXBYJ466E4W3SH5PH72OSGKWE3YHYIZTQ4SSAVYB6EBEUQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:20.173455422 (243h40m44.941138847s) [noise=true , address=89.149.201.147:4023 , piece_id=DRYK3HOGN2TUHZUXG2KR53U2KDFNW3WOWIQPFKOADK7XD4UMYYPQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:20.245445825 (243h40m45.013129261s) [noise=true , address=89.149.201.147:4001 , piece_id=4PP5KWKQWYJCTTLLG3ZQPVE44ZAVWQDEK4DWBOKVNW4WI6E4OKMA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:22.191180405 (243h40m46.958863841s) [noise=true , address=89.149.201.147:4003 , piece_id=QILBUGFQ6WMNOI2FAZTEVWREPQGMI27LNQ2QI5AORZZRDZZ3K7YA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:22.583267895 (243h40m47.35095132s) [noise=true , address=185.167.204.205:4017 , piece_id=X7X47GAFTY6JIQ4HAP364ABBY2TF5V7EPGNZG6J57BMIUWOSPRBA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:24.810390053 (243h40m49.578073479s) [noise=true , address=185.167.204.206:4052 , piece_id=C7WFPIJVOM6C5GKXLNGIOMH6ZAZGGAY7R6THAKB7TLVWBHSWOT6Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:25.641179406 (243h40m50.408862832s) [noise=true , address=185.167.204.205:4015 , piece_id=KF2ENYHUIBVXDGYJ7HCK262MMIGKN3TXDYALX3RYXN7WKKUSDE4A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:25.997384028 (243h40m50.765067456s) [noise=true , address=185.167.204.205:4006 , piece_id=RNHU3X5ELFCOE4FMB2ZJZHBTSWWNPL66BGB7STLGIF6OM7AUCJ7Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:27.585033675 (243h40m52.3527171s) [noise=true , address=89.149.201.147:4002 , piece_id=3MILEDK2IJFOA5I5CTHRHXHH6TBHCK4PBEECT6PSJ2NGUYCHHEWA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:28.545851979 (243h40m53.313535413s) [noise=true , address=185.167.204.205:4024 , piece_id=HKUZDC63JZTO4X74XZQPYCDEI3QHSSZFKEV6SEMKE5OWBL55RW7A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:30.131680481 (243h40m54.899363911s) [noise=true , address=89.149.201.147:4017 , piece_id=J6XPZTMH73W4J2VH34QC4D4575ZLMPARNH6OZD53WO2SLDBUPIXA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:38.128354246 (243h41m2.896037676s) [noise=true , address=185.167.204.206:4045 , piece_id=TLAXGL5WA553KJ6ODOAIH4ZN3WBBTXT2VWTHMEQIN77MXPY24LAA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:41.974219207 (243h41m6.74190262s) [noise=true , address=185.167.204.205:4009 , piece_id=OAWIL6OKSUNVDVZCPGXFJJMVM5N2LBRGF6GOZRVMK3UDAU3HDYYA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:42.357309370 (243h41m7.124992795s) [noise=true , address=185.167.204.205:4033 , piece_id=BFLYT6HD3XUX7SVZ7I5LZDOHTWCG4LEQBGNHUBOPU6KZRK5F4P4A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:54.968735050 (243h41m19.736418465s) [noise=true , address=185.167.204.205:4026 , piece_id=W2IIMQXQLPCYJQPSEBR7NO5U6F3XL4CKL66WMAJDEVR4KAOTP3WQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:08.832186582 (243h41m33.599870007s) [noise=true , address=81.171.14.70:4041 , piece_id=P4T5LKLZ4DGJEPS6KUKEZMIPJ77T2EGZEU6BM5NTEBSMTTKZZPKQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:09.432091332 (243h41m34.199774758s) [noise=true , address=81.171.14.70:4035 , piece_id=XGCREFPMPTINYW7QX3T4W5HF7GTZSUZ77N4KAYT3OYUWLCUSJC2Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:10.126748502 (243h41m34.894431914s) [noise=true , address=81.171.14.70:4030 , piece_id=3Y2VUW6MIXLDXOZPHFEWSZNEJ2CZJVS5JRPMUZG5KBC3VHAKU5CA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:10.955637497 (243h41m35.723320923s) [noise=true , address=81.171.14.70:4042 , piece_id=BDFTS6NXJLGUXBG6SWMCR2UK6L5REBFBWGBB2TMJFLJQKL37U53Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:11.831525196 (243h41m36.599208624s) [noise=true , address=81.171.14.70:4032 , piece_id=PLOMGVUNJBQYBVA4RWCYNRGMRCF5CRMS6SCXIG3HKASRA4VNAE7A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:16.062589282 (243h41m40.83027271s) [noise=true , address=81.171.14.70:4028 , piece_id=AK2CWOZIXSHPD2CXDBYDDOK5PM35Q4VUXRCJRDYL5YILIPIW3ZNA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: read tcp 159.223.143.39:55578->81.171.14.70:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.062759086 (243h41m40.830442517s) [noise=true , address=81.171.14.70:4046 , piece_id=ADRWKWGHKDFTSTNZOM4V2UNRHVRBX6IXWAPPPW5DSXQYQN3ZRI4A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: rpc: dial tcp 81.171.14.70:4046: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.063010482 (243h41m40.830693913s) [noise=true , address=81.171.14.70:4027 , piece_id=LQG6OQ2C37PWRAEFMLZWIOIEGTVP25RYIOK4H64YSPGT32FMDW6Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 159.223.143.39:38588->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.063157039 (243h41m40.830840474s) [noise=true , address=185.167.204.205:4004 , piece_id=653KFRZJSTM6GESRAF2L4NCUMB7E54PG52A6OOPNKPP7JUAFBNWA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.063355188 (243h41m40.831038616s) [noise=true , address=185.167.204.205:4028 , piece_id=KTSAZC72EG4W4CQD2G4ZLAWGZXLRRQ2FDGT6HQC3AG3ASIPX7PIQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: write tcp 159.223.143.39:33488->185.167.204.205:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.063385546 (243h41m40.831068972s) [seg_pos={0 0}, upload=253421]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 21 13:28:16.157185589 (243h41m40.924869014s) [upload=253421]: Done uploading segments... Nov 21 13:28:16.157220987 (243h41m40.924904412s) [upload=253421]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 2.439793718s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X.............X...] duration: 2.501731917s trace: https://jaeger.dev.storj.io/trace/47811fe2fbaa96eb FAIL (2025-11-21 13:29:39 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== 4024 , piece_id=A6VFSY5DRWHUYR2ZTJWSKOCUKA6PIP5EIX3HLKXEKFEOEEZKEYXQ, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.456744444 (243h40m41.224427869s) [noise=true , address=185.167.204.205:4009 , piece_id=OAWIL6OKSUNVDVZCPGXFJJMVM5N2LBRGF6GOZRVMK3UDAU3HDYYA, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.457344616 (243h40m41.225028049s) [noise=true , address=81.171.14.70:4041 , piece_id=P4T5LKLZ4DGJEPS6KUKEZMIPJ77T2EGZEU6BM5NTEBSMTTKZZPKQ, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.457944980 (243h40m41.225628412s) [noise=true , address=81.171.14.70:4042 , piece_id=BDFTS6NXJLGUXBG6SWMCR2UK6L5REBFBWGBB2TMJFLJQKL37U53Q, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.458830101 (243h40m41.226513532s) [noise=true , address=89.149.201.147:4003 , piece_id=QILBUGFQ6WMNOI2FAZTEVWREPQGMI27LNQ2QI5AORZZRDZZ3K7YA, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.459239982 (243h40m41.226923419s) [noise=true , address=81.171.14.70:4046 , piece_id=ADRWKWGHKDFTSTNZOM4V2UNRHVRBX6IXWAPPPW5DSXQYQN3ZRI4A, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.459918472 (243h40m41.227601907s) [noise=true , address=81.171.14.70:4028 , piece_id=AK2CWOZIXSHPD2CXDBYDDOK5PM35Q4VUXRCJRDYL5YILIPIW3ZNA, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.460546153 (243h40m41.228229587s) [noise=true , address=89.149.201.147:4009 , piece_id=5ZEI7EYCVNCOC2AHFPFXGUO42PMO446WNDGD4JC5RAR5AQ4D4ONA, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.461289352 (243h40m41.22897278s) [noise=true , address=185.167.204.205:4028 , piece_id=KTSAZC72EG4W4CQD2G4ZLAWGZXLRRQ2FDGT6HQC3AG3ASIPX7PIQ, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.461661307 (243h40m41.229344739s) [noise=true , address=81.171.14.70:4032 , piece_id=PLOMGVUNJBQYBVA4RWCYNRGMRCF5CRMS6SCXIG3HKASRA4VNAE7A, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:17.334210248 (243h40m42.101893673s) [upload=253421]: Next returned nil segment Nov 21 13:27:17.334234298 (243h40m42.101917722s) [upload=253421]: Waiting for error group managing segments... Nov 21 13:27:18.519937220 (243h40m43.287620646s) [noise=true , address=89.149.201.147:4016 , piece_id=DKIXZHH6GBTI6ZIFKYBVRA6WW4UP4NWJ7IVH2DIPOUCIWYUXFOLQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:18.830542349 (243h40m43.598225774s) [noise=true , address=89.149.201.147:4009 , piece_id=5ZEI7EYCVNCOC2AHFPFXGUO42PMO446WNDGD4JC5RAR5AQ4D4ONA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:19.412300923 (243h40m44.17998434s) [noise=true , address=89.149.201.147:4024 , piece_id=A6VFSY5DRWHUYR2ZTJWSKOCUKA6PIP5EIX3HLKXEKFEOEEZKEYXQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:19.841290059 (243h40m44.608973472s) [noise=true , address=89.149.201.147:4008 , piece_id=GJS7LWBXBYJ466E4W3SH5PH72OSGKWE3YHYIZTQ4SSAVYB6EBEUQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:20.173455422 (243h40m44.941138847s) [noise=true , address=89.149.201.147:4023 , piece_id=DRYK3HOGN2TUHZUXG2KR53U2KDFNW3WOWIQPFKOADK7XD4UMYYPQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:20.245445825 (243h40m45.013129261s) [noise=true , address=89.149.201.147:4001 , piece_id=4PP5KWKQWYJCTTLLG3ZQPVE44ZAVWQDEK4DWBOKVNW4WI6E4OKMA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:22.191180405 (243h40m46.958863841s) [noise=true , address=89.149.201.147:4003 , piece_id=QILBUGFQ6WMNOI2FAZTEVWREPQGMI27LNQ2QI5AORZZRDZZ3K7YA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:22.583267895 (243h40m47.35095132s) [noise=true , address=185.167.204.205:4017 , piece_id=X7X47GAFTY6JIQ4HAP364ABBY2TF5V7EPGNZG6J57BMIUWOSPRBA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:24.810390053 (243h40m49.578073479s) [noise=true , address=185.167.204.206:4052 , piece_id=C7WFPIJVOM6C5GKXLNGIOMH6ZAZGGAY7R6THAKB7TLVWBHSWOT6Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:25.641179406 (243h40m50.408862832s) [noise=true , address=185.167.204.205:4015 , piece_id=KF2ENYHUIBVXDGYJ7HCK262MMIGKN3TXDYALX3RYXN7WKKUSDE4A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:25.997384028 (243h40m50.765067456s) [noise=true , address=185.167.204.205:4006 , piece_id=RNHU3X5ELFCOE4FMB2ZJZHBTSWWNPL66BGB7STLGIF6OM7AUCJ7Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:27.585033675 (243h40m52.3527171s) [noise=true , address=89.149.201.147:4002 , piece_id=3MILEDK2IJFOA5I5CTHRHXHH6TBHCK4PBEECT6PSJ2NGUYCHHEWA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:28.545851979 (243h40m53.313535413s) [noise=true , address=185.167.204.205:4024 , piece_id=HKUZDC63JZTO4X74XZQPYCDEI3QHSSZFKEV6SEMKE5OWBL55RW7A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:30.131680481 (243h40m54.899363911s) [noise=true , address=89.149.201.147:4017 , piece_id=J6XPZTMH73W4J2VH34QC4D4575ZLMPARNH6OZD53WO2SLDBUPIXA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:38.128354246 (243h41m2.896037676s) [noise=true , address=185.167.204.206:4045 , piece_id=TLAXGL5WA553KJ6ODOAIH4ZN3WBBTXT2VWTHMEQIN77MXPY24LAA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:41.974219207 (243h41m6.74190262s) [noise=true , address=185.167.204.205:4009 , piece_id=OAWIL6OKSUNVDVZCPGXFJJMVM5N2LBRGF6GOZRVMK3UDAU3HDYYA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:42.357309370 (243h41m7.124992795s) [noise=true , address=185.167.204.205:4033 , piece_id=BFLYT6HD3XUX7SVZ7I5LZDOHTWCG4LEQBGNHUBOPU6KZRK5F4P4A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:54.968735050 (243h41m19.736418465s) [noise=true , address=185.167.204.205:4026 , piece_id=W2IIMQXQLPCYJQPSEBR7NO5U6F3XL4CKL66WMAJDEVR4KAOTP3WQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:08.832186582 (243h41m33.599870007s) [noise=true , address=81.171.14.70:4041 , piece_id=P4T5LKLZ4DGJEPS6KUKEZMIPJ77T2EGZEU6BM5NTEBSMTTKZZPKQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:09.432091332 (243h41m34.199774758s) [noise=true , address=81.171.14.70:4035 , piece_id=XGCREFPMPTINYW7QX3T4W5HF7GTZSUZ77N4KAYT3OYUWLCUSJC2Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:10.126748502 (243h41m34.894431914s) [noise=true , address=81.171.14.70:4030 , piece_id=3Y2VUW6MIXLDXOZPHFEWSZNEJ2CZJVS5JRPMUZG5KBC3VHAKU5CA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:10.955637497 (243h41m35.723320923s) [noise=true , address=81.171.14.70:4042 , piece_id=BDFTS6NXJLGUXBG6SWMCR2UK6L5REBFBWGBB2TMJFLJQKL37U53Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:11.831525196 (243h41m36.599208624s) [noise=true , address=81.171.14.70:4032 , piece_id=PLOMGVUNJBQYBVA4RWCYNRGMRCF5CRMS6SCXIG3HKASRA4VNAE7A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:16.062589282 (243h41m40.83027271s) [noise=true , address=81.171.14.70:4028 , piece_id=AK2CWOZIXSHPD2CXDBYDDOK5PM35Q4VUXRCJRDYL5YILIPIW3ZNA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: read tcp 159.223.143.39:55578->81.171.14.70:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.062759086 (243h41m40.830442517s) [noise=true , address=81.171.14.70:4046 , piece_id=ADRWKWGHKDFTSTNZOM4V2UNRHVRBX6IXWAPPPW5DSXQYQN3ZRI4A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: rpc: dial tcp 81.171.14.70:4046: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.063010482 (243h41m40.830693913s) [noise=true , address=81.171.14.70:4027 , piece_id=LQG6OQ2C37PWRAEFMLZWIOIEGTVP25RYIOK4H64YSPGT32FMDW6Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 159.223.143.39:38588->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.063157039 (243h41m40.830840474s) [noise=true , address=185.167.204.205:4004 , piece_id=653KFRZJSTM6GESRAF2L4NCUMB7E54PG52A6OOPNKPP7JUAFBNWA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.063355188 (243h41m40.831038616s) [noise=true , address=185.167.204.205:4028 , piece_id=KTSAZC72EG4W4CQD2G4ZLAWGZXLRRQ2FDGT6HQC3AG3ASIPX7PIQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: write tcp 159.223.143.39:33488->185.167.204.205:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.063385546 (243h41m40.831068972s) [seg_pos={0 0}, upload=253421]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 21 13:28:16.157185589 (243h41m40.924869014s) [upload=253421]: Done uploading segments... Nov 21 13:28:16.157220987 (243h41m40.924904412s) [upload=253421]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 2.501756053s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [...........................................X.............X..] duration: 2.49694494s trace: https://jaeger.dev.storj.io/trace/47811fe2fbaa96eb FAIL (2025-11-21 13:28:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== 4024 , piece_id=A6VFSY5DRWHUYR2ZTJWSKOCUKA6PIP5EIX3HLKXEKFEOEEZKEYXQ, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.456744444 (243h40m41.224427869s) [noise=true , address=185.167.204.205:4009 , piece_id=OAWIL6OKSUNVDVZCPGXFJJMVM5N2LBRGF6GOZRVMK3UDAU3HDYYA, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.457344616 (243h40m41.225028049s) [noise=true , address=81.171.14.70:4041 , piece_id=P4T5LKLZ4DGJEPS6KUKEZMIPJ77T2EGZEU6BM5NTEBSMTTKZZPKQ, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.457944980 (243h40m41.225628412s) [noise=true , address=81.171.14.70:4042 , piece_id=BDFTS6NXJLGUXBG6SWMCR2UK6L5REBFBWGBB2TMJFLJQKL37U53Q, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.458830101 (243h40m41.226513532s) [noise=true , address=89.149.201.147:4003 , piece_id=QILBUGFQ6WMNOI2FAZTEVWREPQGMI27LNQ2QI5AORZZRDZZ3K7YA, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.459239982 (243h40m41.226923419s) [noise=true , address=81.171.14.70:4046 , piece_id=ADRWKWGHKDFTSTNZOM4V2UNRHVRBX6IXWAPPPW5DSXQYQN3ZRI4A, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.459918472 (243h40m41.227601907s) [noise=true , address=81.171.14.70:4028 , piece_id=AK2CWOZIXSHPD2CXDBYDDOK5PM35Q4VUXRCJRDYL5YILIPIW3ZNA, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.460546153 (243h40m41.228229587s) [noise=true , address=89.149.201.147:4009 , piece_id=5ZEI7EYCVNCOC2AHFPFXGUO42PMO446WNDGD4JC5RAR5AQ4D4ONA, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.461289352 (243h40m41.22897278s) [noise=true , address=185.167.204.205:4028 , piece_id=KTSAZC72EG4W4CQD2G4ZLAWGZXLRRQ2FDGT6HQC3AG3ASIPX7PIQ, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.461661307 (243h40m41.229344739s) [noise=true , address=81.171.14.70:4032 , piece_id=PLOMGVUNJBQYBVA4RWCYNRGMRCF5CRMS6SCXIG3HKASRA4VNAE7A, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:17.334210248 (243h40m42.101893673s) [upload=253421]: Next returned nil segment Nov 21 13:27:17.334234298 (243h40m42.101917722s) [upload=253421]: Waiting for error group managing segments... Nov 21 13:27:18.519937220 (243h40m43.287620646s) [noise=true , address=89.149.201.147:4016 , piece_id=DKIXZHH6GBTI6ZIFKYBVRA6WW4UP4NWJ7IVH2DIPOUCIWYUXFOLQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:18.830542349 (243h40m43.598225774s) [noise=true , address=89.149.201.147:4009 , piece_id=5ZEI7EYCVNCOC2AHFPFXGUO42PMO446WNDGD4JC5RAR5AQ4D4ONA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:19.412300923 (243h40m44.17998434s) [noise=true , address=89.149.201.147:4024 , piece_id=A6VFSY5DRWHUYR2ZTJWSKOCUKA6PIP5EIX3HLKXEKFEOEEZKEYXQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:19.841290059 (243h40m44.608973472s) [noise=true , address=89.149.201.147:4008 , piece_id=GJS7LWBXBYJ466E4W3SH5PH72OSGKWE3YHYIZTQ4SSAVYB6EBEUQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:20.173455422 (243h40m44.941138847s) [noise=true , address=89.149.201.147:4023 , piece_id=DRYK3HOGN2TUHZUXG2KR53U2KDFNW3WOWIQPFKOADK7XD4UMYYPQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:20.245445825 (243h40m45.013129261s) [noise=true , address=89.149.201.147:4001 , piece_id=4PP5KWKQWYJCTTLLG3ZQPVE44ZAVWQDEK4DWBOKVNW4WI6E4OKMA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:22.191180405 (243h40m46.958863841s) [noise=true , address=89.149.201.147:4003 , piece_id=QILBUGFQ6WMNOI2FAZTEVWREPQGMI27LNQ2QI5AORZZRDZZ3K7YA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:22.583267895 (243h40m47.35095132s) [noise=true , address=185.167.204.205:4017 , piece_id=X7X47GAFTY6JIQ4HAP364ABBY2TF5V7EPGNZG6J57BMIUWOSPRBA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:24.810390053 (243h40m49.578073479s) [noise=true , address=185.167.204.206:4052 , piece_id=C7WFPIJVOM6C5GKXLNGIOMH6ZAZGGAY7R6THAKB7TLVWBHSWOT6Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:25.641179406 (243h40m50.408862832s) [noise=true , address=185.167.204.205:4015 , piece_id=KF2ENYHUIBVXDGYJ7HCK262MMIGKN3TXDYALX3RYXN7WKKUSDE4A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:25.997384028 (243h40m50.765067456s) [noise=true , address=185.167.204.205:4006 , piece_id=RNHU3X5ELFCOE4FMB2ZJZHBTSWWNPL66BGB7STLGIF6OM7AUCJ7Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:27.585033675 (243h40m52.3527171s) [noise=true , address=89.149.201.147:4002 , piece_id=3MILEDK2IJFOA5I5CTHRHXHH6TBHCK4PBEECT6PSJ2NGUYCHHEWA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:28.545851979 (243h40m53.313535413s) [noise=true , address=185.167.204.205:4024 , piece_id=HKUZDC63JZTO4X74XZQPYCDEI3QHSSZFKEV6SEMKE5OWBL55RW7A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:30.131680481 (243h40m54.899363911s) [noise=true , address=89.149.201.147:4017 , piece_id=J6XPZTMH73W4J2VH34QC4D4575ZLMPARNH6OZD53WO2SLDBUPIXA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:38.128354246 (243h41m2.896037676s) [noise=true , address=185.167.204.206:4045 , piece_id=TLAXGL5WA553KJ6ODOAIH4ZN3WBBTXT2VWTHMEQIN77MXPY24LAA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:41.974219207 (243h41m6.74190262s) [noise=true , address=185.167.204.205:4009 , piece_id=OAWIL6OKSUNVDVZCPGXFJJMVM5N2LBRGF6GOZRVMK3UDAU3HDYYA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:42.357309370 (243h41m7.124992795s) [noise=true , address=185.167.204.205:4033 , piece_id=BFLYT6HD3XUX7SVZ7I5LZDOHTWCG4LEQBGNHUBOPU6KZRK5F4P4A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:54.968735050 (243h41m19.736418465s) [noise=true , address=185.167.204.205:4026 , piece_id=W2IIMQXQLPCYJQPSEBR7NO5U6F3XL4CKL66WMAJDEVR4KAOTP3WQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:08.832186582 (243h41m33.599870007s) [noise=true , address=81.171.14.70:4041 , piece_id=P4T5LKLZ4DGJEPS6KUKEZMIPJ77T2EGZEU6BM5NTEBSMTTKZZPKQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:09.432091332 (243h41m34.199774758s) [noise=true , address=81.171.14.70:4035 , piece_id=XGCREFPMPTINYW7QX3T4W5HF7GTZSUZ77N4KAYT3OYUWLCUSJC2Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:10.126748502 (243h41m34.894431914s) [noise=true , address=81.171.14.70:4030 , piece_id=3Y2VUW6MIXLDXOZPHFEWSZNEJ2CZJVS5JRPMUZG5KBC3VHAKU5CA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:10.955637497 (243h41m35.723320923s) [noise=true , address=81.171.14.70:4042 , piece_id=BDFTS6NXJLGUXBG6SWMCR2UK6L5REBFBWGBB2TMJFLJQKL37U53Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:11.831525196 (243h41m36.599208624s) [noise=true , address=81.171.14.70:4032 , piece_id=PLOMGVUNJBQYBVA4RWCYNRGMRCF5CRMS6SCXIG3HKASRA4VNAE7A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:16.062589282 (243h41m40.83027271s) [noise=true , address=81.171.14.70:4028 , piece_id=AK2CWOZIXSHPD2CXDBYDDOK5PM35Q4VUXRCJRDYL5YILIPIW3ZNA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: read tcp 159.223.143.39:55578->81.171.14.70:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.062759086 (243h41m40.830442517s) [noise=true , address=81.171.14.70:4046 , piece_id=ADRWKWGHKDFTSTNZOM4V2UNRHVRBX6IXWAPPPW5DSXQYQN3ZRI4A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: rpc: dial tcp 81.171.14.70:4046: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.063010482 (243h41m40.830693913s) [noise=true , address=81.171.14.70:4027 , piece_id=LQG6OQ2C37PWRAEFMLZWIOIEGTVP25RYIOK4H64YSPGT32FMDW6Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 159.223.143.39:38588->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.063157039 (243h41m40.830840474s) [noise=true , address=185.167.204.205:4004 , piece_id=653KFRZJSTM6GESRAF2L4NCUMB7E54PG52A6OOPNKPP7JUAFBNWA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.063355188 (243h41m40.831038616s) [noise=true , address=185.167.204.205:4028 , piece_id=KTSAZC72EG4W4CQD2G4ZLAWGZXLRRQ2FDGT6HQC3AG3ASIPX7PIQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: write tcp 159.223.143.39:33488->185.167.204.205:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.063385546 (243h41m40.831068972s) [seg_pos={0 0}, upload=253421]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 21 13:28:16.157185589 (243h41m40.924869014s) [upload=253421]: Done uploading segments... Nov 21 13:28:16.157220987 (243h41m40.924904412s) [upload=253421]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 2.496972255s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [............................................X.............X.] duration: 17.502111016s trace: https://jaeger.dev.storj.io/trace/47811fe2fbaa96eb FAIL (2025-11-21 13:28:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== 4024 , piece_id=A6VFSY5DRWHUYR2ZTJWSKOCUKA6PIP5EIX3HLKXEKFEOEEZKEYXQ, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.456744444 (243h40m41.224427869s) [noise=true , address=185.167.204.205:4009 , piece_id=OAWIL6OKSUNVDVZCPGXFJJMVM5N2LBRGF6GOZRVMK3UDAU3HDYYA, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.457344616 (243h40m41.225028049s) [noise=true , address=81.171.14.70:4041 , piece_id=P4T5LKLZ4DGJEPS6KUKEZMIPJ77T2EGZEU6BM5NTEBSMTTKZZPKQ, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.457944980 (243h40m41.225628412s) [noise=true , address=81.171.14.70:4042 , piece_id=BDFTS6NXJLGUXBG6SWMCR2UK6L5REBFBWGBB2TMJFLJQKL37U53Q, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.458830101 (243h40m41.226513532s) [noise=true , address=89.149.201.147:4003 , piece_id=QILBUGFQ6WMNOI2FAZTEVWREPQGMI27LNQ2QI5AORZZRDZZ3K7YA, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.459239982 (243h40m41.226923419s) [noise=true , address=81.171.14.70:4046 , piece_id=ADRWKWGHKDFTSTNZOM4V2UNRHVRBX6IXWAPPPW5DSXQYQN3ZRI4A, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.459918472 (243h40m41.227601907s) [noise=true , address=81.171.14.70:4028 , piece_id=AK2CWOZIXSHPD2CXDBYDDOK5PM35Q4VUXRCJRDYL5YILIPIW3ZNA, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.460546153 (243h40m41.228229587s) [noise=true , address=89.149.201.147:4009 , piece_id=5ZEI7EYCVNCOC2AHFPFXGUO42PMO446WNDGD4JC5RAR5AQ4D4ONA, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.461289352 (243h40m41.22897278s) [noise=true , address=185.167.204.205:4028 , piece_id=KTSAZC72EG4W4CQD2G4ZLAWGZXLRRQ2FDGT6HQC3AG3ASIPX7PIQ, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.461661307 (243h40m41.229344739s) [noise=true , address=81.171.14.70:4032 , piece_id=PLOMGVUNJBQYBVA4RWCYNRGMRCF5CRMS6SCXIG3HKASRA4VNAE7A, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:17.334210248 (243h40m42.101893673s) [upload=253421]: Next returned nil segment Nov 21 13:27:17.334234298 (243h40m42.101917722s) [upload=253421]: Waiting for error group managing segments... Nov 21 13:27:18.519937220 (243h40m43.287620646s) [noise=true , address=89.149.201.147:4016 , piece_id=DKIXZHH6GBTI6ZIFKYBVRA6WW4UP4NWJ7IVH2DIPOUCIWYUXFOLQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:18.830542349 (243h40m43.598225774s) [noise=true , address=89.149.201.147:4009 , piece_id=5ZEI7EYCVNCOC2AHFPFXGUO42PMO446WNDGD4JC5RAR5AQ4D4ONA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:19.412300923 (243h40m44.17998434s) [noise=true , address=89.149.201.147:4024 , piece_id=A6VFSY5DRWHUYR2ZTJWSKOCUKA6PIP5EIX3HLKXEKFEOEEZKEYXQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:19.841290059 (243h40m44.608973472s) [noise=true , address=89.149.201.147:4008 , piece_id=GJS7LWBXBYJ466E4W3SH5PH72OSGKWE3YHYIZTQ4SSAVYB6EBEUQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:20.173455422 (243h40m44.941138847s) [noise=true , address=89.149.201.147:4023 , piece_id=DRYK3HOGN2TUHZUXG2KR53U2KDFNW3WOWIQPFKOADK7XD4UMYYPQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:20.245445825 (243h40m45.013129261s) [noise=true , address=89.149.201.147:4001 , piece_id=4PP5KWKQWYJCTTLLG3ZQPVE44ZAVWQDEK4DWBOKVNW4WI6E4OKMA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:22.191180405 (243h40m46.958863841s) [noise=true , address=89.149.201.147:4003 , piece_id=QILBUGFQ6WMNOI2FAZTEVWREPQGMI27LNQ2QI5AORZZRDZZ3K7YA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:22.583267895 (243h40m47.35095132s) [noise=true , address=185.167.204.205:4017 , piece_id=X7X47GAFTY6JIQ4HAP364ABBY2TF5V7EPGNZG6J57BMIUWOSPRBA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:24.810390053 (243h40m49.578073479s) [noise=true , address=185.167.204.206:4052 , piece_id=C7WFPIJVOM6C5GKXLNGIOMH6ZAZGGAY7R6THAKB7TLVWBHSWOT6Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:25.641179406 (243h40m50.408862832s) [noise=true , address=185.167.204.205:4015 , piece_id=KF2ENYHUIBVXDGYJ7HCK262MMIGKN3TXDYALX3RYXN7WKKUSDE4A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:25.997384028 (243h40m50.765067456s) [noise=true , address=185.167.204.205:4006 , piece_id=RNHU3X5ELFCOE4FMB2ZJZHBTSWWNPL66BGB7STLGIF6OM7AUCJ7Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:27.585033675 (243h40m52.3527171s) [noise=true , address=89.149.201.147:4002 , piece_id=3MILEDK2IJFOA5I5CTHRHXHH6TBHCK4PBEECT6PSJ2NGUYCHHEWA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:28.545851979 (243h40m53.313535413s) [noise=true , address=185.167.204.205:4024 , piece_id=HKUZDC63JZTO4X74XZQPYCDEI3QHSSZFKEV6SEMKE5OWBL55RW7A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:30.131680481 (243h40m54.899363911s) [noise=true , address=89.149.201.147:4017 , piece_id=J6XPZTMH73W4J2VH34QC4D4575ZLMPARNH6OZD53WO2SLDBUPIXA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:38.128354246 (243h41m2.896037676s) [noise=true , address=185.167.204.206:4045 , piece_id=TLAXGL5WA553KJ6ODOAIH4ZN3WBBTXT2VWTHMEQIN77MXPY24LAA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:41.974219207 (243h41m6.74190262s) [noise=true , address=185.167.204.205:4009 , piece_id=OAWIL6OKSUNVDVZCPGXFJJMVM5N2LBRGF6GOZRVMK3UDAU3HDYYA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:42.357309370 (243h41m7.124992795s) [noise=true , address=185.167.204.205:4033 , piece_id=BFLYT6HD3XUX7SVZ7I5LZDOHTWCG4LEQBGNHUBOPU6KZRK5F4P4A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:54.968735050 (243h41m19.736418465s) [noise=true , address=185.167.204.205:4026 , piece_id=W2IIMQXQLPCYJQPSEBR7NO5U6F3XL4CKL66WMAJDEVR4KAOTP3WQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:08.832186582 (243h41m33.599870007s) [noise=true , address=81.171.14.70:4041 , piece_id=P4T5LKLZ4DGJEPS6KUKEZMIPJ77T2EGZEU6BM5NTEBSMTTKZZPKQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:09.432091332 (243h41m34.199774758s) [noise=true , address=81.171.14.70:4035 , piece_id=XGCREFPMPTINYW7QX3T4W5HF7GTZSUZ77N4KAYT3OYUWLCUSJC2Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:10.126748502 (243h41m34.894431914s) [noise=true , address=81.171.14.70:4030 , piece_id=3Y2VUW6MIXLDXOZPHFEWSZNEJ2CZJVS5JRPMUZG5KBC3VHAKU5CA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:10.955637497 (243h41m35.723320923s) [noise=true , address=81.171.14.70:4042 , piece_id=BDFTS6NXJLGUXBG6SWMCR2UK6L5REBFBWGBB2TMJFLJQKL37U53Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:11.831525196 (243h41m36.599208624s) [noise=true , address=81.171.14.70:4032 , piece_id=PLOMGVUNJBQYBVA4RWCYNRGMRCF5CRMS6SCXIG3HKASRA4VNAE7A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:16.062589282 (243h41m40.83027271s) [noise=true , address=81.171.14.70:4028 , piece_id=AK2CWOZIXSHPD2CXDBYDDOK5PM35Q4VUXRCJRDYL5YILIPIW3ZNA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: read tcp 159.223.143.39:55578->81.171.14.70:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.062759086 (243h41m40.830442517s) [noise=true , address=81.171.14.70:4046 , piece_id=ADRWKWGHKDFTSTNZOM4V2UNRHVRBX6IXWAPPPW5DSXQYQN3ZRI4A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: rpc: dial tcp 81.171.14.70:4046: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.063010482 (243h41m40.830693913s) [noise=true , address=81.171.14.70:4027 , piece_id=LQG6OQ2C37PWRAEFMLZWIOIEGTVP25RYIOK4H64YSPGT32FMDW6Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 159.223.143.39:38588->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.063157039 (243h41m40.830840474s) [noise=true , address=185.167.204.205:4004 , piece_id=653KFRZJSTM6GESRAF2L4NCUMB7E54PG52A6OOPNKPP7JUAFBNWA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.063355188 (243h41m40.831038616s) [noise=true , address=185.167.204.205:4028 , piece_id=KTSAZC72EG4W4CQD2G4ZLAWGZXLRRQ2FDGT6HQC3AG3ASIPX7PIQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: write tcp 159.223.143.39:33488->185.167.204.205:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.063385546 (243h41m40.831068972s) [seg_pos={0 0}, upload=253421]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 21 13:28:16.157185589 (243h41m40.924869014s) [upload=253421]: Done uploading segments... Nov 21 13:28:16.157220987 (243h41m40.924904412s) [upload=253421]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 17.502131149s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.............................................X.............X] duration: 1m0.096995557s trace: https://jaeger.dev.storj.io/trace/47811fe2fbaa96eb FAIL (2025-11-21 13:28:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== 4024 , piece_id=A6VFSY5DRWHUYR2ZTJWSKOCUKA6PIP5EIX3HLKXEKFEOEEZKEYXQ, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.456744444 (243h40m41.224427869s) [noise=true , address=185.167.204.205:4009 , piece_id=OAWIL6OKSUNVDVZCPGXFJJMVM5N2LBRGF6GOZRVMK3UDAU3HDYYA, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.457344616 (243h40m41.225028049s) [noise=true , address=81.171.14.70:4041 , piece_id=P4T5LKLZ4DGJEPS6KUKEZMIPJ77T2EGZEU6BM5NTEBSMTTKZZPKQ, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.457944980 (243h40m41.225628412s) [noise=true , address=81.171.14.70:4042 , piece_id=BDFTS6NXJLGUXBG6SWMCR2UK6L5REBFBWGBB2TMJFLJQKL37U53Q, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.458830101 (243h40m41.226513532s) [noise=true , address=89.149.201.147:4003 , piece_id=QILBUGFQ6WMNOI2FAZTEVWREPQGMI27LNQ2QI5AORZZRDZZ3K7YA, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.459239982 (243h40m41.226923419s) [noise=true , address=81.171.14.70:4046 , piece_id=ADRWKWGHKDFTSTNZOM4V2UNRHVRBX6IXWAPPPW5DSXQYQN3ZRI4A, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.459918472 (243h40m41.227601907s) [noise=true , address=81.171.14.70:4028 , piece_id=AK2CWOZIXSHPD2CXDBYDDOK5PM35Q4VUXRCJRDYL5YILIPIW3ZNA, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.460546153 (243h40m41.228229587s) [noise=true , address=89.149.201.147:4009 , piece_id=5ZEI7EYCVNCOC2AHFPFXGUO42PMO446WNDGD4JC5RAR5AQ4D4ONA, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.461289352 (243h40m41.22897278s) [noise=true , address=185.167.204.205:4028 , piece_id=KTSAZC72EG4W4CQD2G4ZLAWGZXLRRQ2FDGT6HQC3AG3ASIPX7PIQ, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:16.461661307 (243h40m41.229344739s) [noise=true , address=81.171.14.70:4032 , piece_id=PLOMGVUNJBQYBVA4RWCYNRGMRCF5CRMS6SCXIG3HKASRA4VNAE7A, seg_pos={0 0}, upload=253421]: Uploading piece... Nov 21 13:27:17.334210248 (243h40m42.101893673s) [upload=253421]: Next returned nil segment Nov 21 13:27:17.334234298 (243h40m42.101917722s) [upload=253421]: Waiting for error group managing segments... Nov 21 13:27:18.519937220 (243h40m43.287620646s) [noise=true , address=89.149.201.147:4016 , piece_id=DKIXZHH6GBTI6ZIFKYBVRA6WW4UP4NWJ7IVH2DIPOUCIWYUXFOLQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:18.830542349 (243h40m43.598225774s) [noise=true , address=89.149.201.147:4009 , piece_id=5ZEI7EYCVNCOC2AHFPFXGUO42PMO446WNDGD4JC5RAR5AQ4D4ONA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:19.412300923 (243h40m44.17998434s) [noise=true , address=89.149.201.147:4024 , piece_id=A6VFSY5DRWHUYR2ZTJWSKOCUKA6PIP5EIX3HLKXEKFEOEEZKEYXQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:19.841290059 (243h40m44.608973472s) [noise=true , address=89.149.201.147:4008 , piece_id=GJS7LWBXBYJ466E4W3SH5PH72OSGKWE3YHYIZTQ4SSAVYB6EBEUQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:20.173455422 (243h40m44.941138847s) [noise=true , address=89.149.201.147:4023 , piece_id=DRYK3HOGN2TUHZUXG2KR53U2KDFNW3WOWIQPFKOADK7XD4UMYYPQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:20.245445825 (243h40m45.013129261s) [noise=true , address=89.149.201.147:4001 , piece_id=4PP5KWKQWYJCTTLLG3ZQPVE44ZAVWQDEK4DWBOKVNW4WI6E4OKMA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:22.191180405 (243h40m46.958863841s) [noise=true , address=89.149.201.147:4003 , piece_id=QILBUGFQ6WMNOI2FAZTEVWREPQGMI27LNQ2QI5AORZZRDZZ3K7YA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:22.583267895 (243h40m47.35095132s) [noise=true , address=185.167.204.205:4017 , piece_id=X7X47GAFTY6JIQ4HAP364ABBY2TF5V7EPGNZG6J57BMIUWOSPRBA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:24.810390053 (243h40m49.578073479s) [noise=true , address=185.167.204.206:4052 , piece_id=C7WFPIJVOM6C5GKXLNGIOMH6ZAZGGAY7R6THAKB7TLVWBHSWOT6Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:25.641179406 (243h40m50.408862832s) [noise=true , address=185.167.204.205:4015 , piece_id=KF2ENYHUIBVXDGYJ7HCK262MMIGKN3TXDYALX3RYXN7WKKUSDE4A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:25.997384028 (243h40m50.765067456s) [noise=true , address=185.167.204.205:4006 , piece_id=RNHU3X5ELFCOE4FMB2ZJZHBTSWWNPL66BGB7STLGIF6OM7AUCJ7Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:27.585033675 (243h40m52.3527171s) [noise=true , address=89.149.201.147:4002 , piece_id=3MILEDK2IJFOA5I5CTHRHXHH6TBHCK4PBEECT6PSJ2NGUYCHHEWA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:28.545851979 (243h40m53.313535413s) [noise=true , address=185.167.204.205:4024 , piece_id=HKUZDC63JZTO4X74XZQPYCDEI3QHSSZFKEV6SEMKE5OWBL55RW7A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:30.131680481 (243h40m54.899363911s) [noise=true , address=89.149.201.147:4017 , piece_id=J6XPZTMH73W4J2VH34QC4D4575ZLMPARNH6OZD53WO2SLDBUPIXA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:38.128354246 (243h41m2.896037676s) [noise=true , address=185.167.204.206:4045 , piece_id=TLAXGL5WA553KJ6ODOAIH4ZN3WBBTXT2VWTHMEQIN77MXPY24LAA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:41.974219207 (243h41m6.74190262s) [noise=true , address=185.167.204.205:4009 , piece_id=OAWIL6OKSUNVDVZCPGXFJJMVM5N2LBRGF6GOZRVMK3UDAU3HDYYA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:42.357309370 (243h41m7.124992795s) [noise=true , address=185.167.204.205:4033 , piece_id=BFLYT6HD3XUX7SVZ7I5LZDOHTWCG4LEQBGNHUBOPU6KZRK5F4P4A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:27:54.968735050 (243h41m19.736418465s) [noise=true , address=185.167.204.205:4026 , piece_id=W2IIMQXQLPCYJQPSEBR7NO5U6F3XL4CKL66WMAJDEVR4KAOTP3WQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:08.832186582 (243h41m33.599870007s) [noise=true , address=81.171.14.70:4041 , piece_id=P4T5LKLZ4DGJEPS6KUKEZMIPJ77T2EGZEU6BM5NTEBSMTTKZZPKQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:09.432091332 (243h41m34.199774758s) [noise=true , address=81.171.14.70:4035 , piece_id=XGCREFPMPTINYW7QX3T4W5HF7GTZSUZ77N4KAYT3OYUWLCUSJC2Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:10.126748502 (243h41m34.894431914s) [noise=true , address=81.171.14.70:4030 , piece_id=3Y2VUW6MIXLDXOZPHFEWSZNEJ2CZJVS5JRPMUZG5KBC3VHAKU5CA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:10.955637497 (243h41m35.723320923s) [noise=true , address=81.171.14.70:4042 , piece_id=BDFTS6NXJLGUXBG6SWMCR2UK6L5REBFBWGBB2TMJFLJQKL37U53Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:11.831525196 (243h41m36.599208624s) [noise=true , address=81.171.14.70:4032 , piece_id=PLOMGVUNJBQYBVA4RWCYNRGMRCF5CRMS6SCXIG3HKASRA4VNAE7A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: <nil> Nov 21 13:28:16.062589282 (243h41m40.83027271s) [noise=true , address=81.171.14.70:4028 , piece_id=AK2CWOZIXSHPD2CXDBYDDOK5PM35Q4VUXRCJRDYL5YILIPIW3ZNA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: read tcp 159.223.143.39:55578->81.171.14.70:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.062759086 (243h41m40.830442517s) [noise=true , address=81.171.14.70:4046 , piece_id=ADRWKWGHKDFTSTNZOM4V2UNRHVRBX6IXWAPPPW5DSXQYQN3ZRI4A, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:1nYU5VwMDm67tjJYHi3jnC6PuKRapsXfziC8wdLroXe7CAJxQ7, address:81.171.14.70:4046): protocol: rpc: dial tcp 81.171.14.70:4046: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.063010482 (243h41m40.830693913s) [noise=true , address=81.171.14.70:4027 , piece_id=LQG6OQ2C37PWRAEFMLZWIOIEGTVP25RYIOK4H64YSPGT32FMDW6Q, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: read tcp 159.223.143.39:38588->81.171.14.70:4027: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.063157039 (243h41m40.830840474s) [noise=true , address=185.167.204.205:4004 , piece_id=653KFRZJSTM6GESRAF2L4NCUMB7E54PG52A6OOPNKPP7JUAFBNWA, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.063355188 (243h41m40.831038616s) [noise=true , address=185.167.204.205:4028 , piece_id=KTSAZC72EG4W4CQD2G4ZLAWGZXLRRQ2FDGT6HQC3AG3ASIPX7PIQ, seg_pos={0 0}, upload=253421]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: write tcp 159.223.143.39:33488->185.167.204.205:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:28:16.063385546 (243h41m40.831068972s) [seg_pos={0 0}, upload=253421]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 21 13:28:16.157185589 (243h41m40.924869014s) [upload=253421]: Done uploading segments... Nov 21 13:28:16.157220987 (243h41m40.924904412s) [upload=253421]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 1m0.097017109s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.062792386s trace: https://jaeger.dev.storj.io/trace/3e276090513c6d3b FAIL (2025-11-21 13:26:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== 5L3BR7D5JBTEHIGBPAID5EJKUBYNETWMJWHJ5A, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.987498478 (243h29m40.755181917s) [noise=true , address=185.167.204.205:4031 , piece_id=IAZRVIE3YHQTNM22UYM4B7TCBYDA2EUMSNIK7C4R3637NTYHSLRQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.988154860 (243h29m40.755838308s) [noise=true , address=89.149.201.147:4009 , piece_id=BOG3EIF5CLQOJ4QOFVVOIYUVQH3YZBJJ5WKJ6BSE5WOF3NQMK5YA, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.988761968 (243h29m40.756445412s) [noise=true , address=185.167.204.206:4055 , piece_id=T2UM73BIH3KOT5XBVY3ZRQNQ672CPH57OKVVSVHVSFZU2D6PPTXQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.989455702 (243h29m40.757139137s) [noise=true , address=89.149.201.147:4021 , piece_id=ZHXGNV4M2G47UN3H6B2KLND3GBEHFIJ4ZDANVUBRX3SUQGTEFR2A, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.990168101 (243h29m40.757851537s) [noise=true , address=89.149.201.147:4018 , piece_id=2SATC6VJT4HHRCIUJWPSRPQGINCCSXTHVRIOKLHH7GAJ42NNAERA, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.990870219 (243h29m40.758553659s) [noise=true , address=185.167.204.206:4047 , piece_id=RIJHJETENKHV23KNYXZ5SSDOR5VLTSQ64IBSFSIKVCYB4SP35IOQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.991676123 (243h29m40.759359559s) [noise=true , address=81.171.14.70:4043 , piece_id=FQ5SR76KXNGIBI2T7AK3XFLN57YO4H5RBAAESPICBOL2L2FCWHBQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.993530722 (243h29m40.761214161s) [noise=true , address=185.167.204.205:4022 , piece_id=35QCU5FIDBUJQFNCJCHKWDDKGPPDXEDBKCNI5A5VMAS7NXZTTNGQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.995576845 (243h29m40.76326028s) [noise=true , address=81.171.14.70:4028 , piece_id=INCSZCH2ZA23DSDXGXBHICU4YMNGTCDNFISNI2SNADPEKOE4I2RQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:16.417071691 (243h29m41.184755117s) [upload=253234]: Next returned nil segment Nov 21 13:16:16.417088568 (243h29m41.184771994s) [upload=253234]: Waiting for error group managing segments... Nov 21 13:16:16.604253953 (243h29m41.37193741s) [noise=true , address=89.149.201.147:4009 , piece_id=BOG3EIF5CLQOJ4QOFVVOIYUVQH3YZBJJ5WKJ6BSE5WOF3NQMK5YA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.616631034 (243h29m41.384314459s) [noise=true , address=89.149.201.147:4022 , piece_id=S4CD6TBJIQGENSR3OUDZSFNUGEKCKG2KF6GS4DN3YAYF3FCK6BRQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.622248975 (243h29m41.389932404s) [noise=true , address=89.149.201.147:4021 , piece_id=ZHXGNV4M2G47UN3H6B2KLND3GBEHFIJ4ZDANVUBRX3SUQGTEFR2A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.622772397 (243h29m41.390455832s) [noise=true , address=89.149.201.147:4005 , piece_id=JVTLH6W7GNBKF6FI5K56GUKQ7LPWGSNZWV2X3TGFOHUKG2COXJDQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.635671178 (243h29m41.403354603s) [noise=true , address=185.167.204.206:4044 , piece_id=TJO4FHXPZWWLIISBTWLX2H4PDWFDGID2LWQAR7TAJGXM3OO6O73Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.638523014 (243h29m41.406206439s) [noise=true , address=185.167.204.206:4045 , piece_id=W26WUTNYVGHDZ6AA5BPGBRLTCXTS4DVWHYSW7ORP44BBJY7HVD2A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.647706039 (243h29m41.415389468s) [noise=true , address=185.167.204.205:4024 , piece_id=UQU4IGX45QTKY5SY5HEKRVCXDHK6PPYDZDTTKEHUDW6JETPQDUNA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.647997350 (243h29m41.415680775s) [noise=true , address=185.167.204.206:4058 , piece_id=75RVJDMPKHI56JQZBD7Y6NZYEWZCWILQM6IXOLHXFBX3ASOPAZCQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.650444384 (243h29m41.418127809s) [noise=true , address=185.167.204.205:4031 , piece_id=IAZRVIE3YHQTNM22UYM4B7TCBYDA2EUMSNIK7C4R3637NTYHSLRQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.651259970 (243h29m41.418943401s) [noise=true , address=185.167.204.206:4067 , piece_id=DYKO7IR5VSJGEYCEM672JGIDQGB4CIURDQ65FFZTC2TJCJCR4A7Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.653940496 (243h29m41.421623925s) [noise=true , address=185.167.204.205:4028 , piece_id=NUAIVIFVS3PIDLDP4I56II7GROUQ4N5HIGUUJLWEKDJM2HISQK7A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.656238559 (243h29m41.423921984s) [noise=true , address=185.167.204.205:4020 , piece_id=PVVA4UFQEOJNEJ2QXAIFREZEBJBSMOLCB7VVGOH5HR2NK4KELPYA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.658552874 (243h29m41.426236299s) [noise=true , address=185.167.204.206:4047 , piece_id=RIJHJETENKHV23KNYXZ5SSDOR5VLTSQ64IBSFSIKVCYB4SP35IOQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.658795439 (243h29m41.426478865s) [noise=true , address=185.167.204.206:4066 , piece_id=IJX27IPYXELRKHIBF3DLKORJ2IX55LRNAGPOUQEUZ3MPBN7FQCSQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.664043937 (243h29m41.431727378s) [noise=true , address=89.149.201.147:4001 , piece_id=6UMZWXB3BYCP6OZJOFREAYMD66PSUVZSNBBDRRYLWZSDDBAIHHYA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.664924438 (243h29m41.432607866s) [noise=true , address=185.167.204.206:4057 , piece_id=UZUKNSI26BGMZUWQULLZMIN7ZZNGVCYRLLFMNWT7KNLOD5GG65SQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.672162093 (243h29m41.439845519s) [noise=true , address=185.167.204.205:4022 , piece_id=35QCU5FIDBUJQFNCJCHKWDDKGPPDXEDBKCNI5A5VMAS7NXZTTNGQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.675169434 (243h29m41.44285286s) [noise=true , address=185.167.204.206:4063 , piece_id=LZ2MWIOS4OFWTV5L3BR7D5JBTEHIGBPAID5EJKUBYNETWMJWHJ5A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.676639209 (243h29m41.444322635s) [noise=true , address=185.167.204.206:4055 , piece_id=T2UM73BIH3KOT5XBVY3ZRQNQ672CPH57OKVVSVHVSFZU2D6PPTXQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.677425453 (243h29m41.445108879s) [noise=true , address=89.149.201.147:4018 , piece_id=2SATC6VJT4HHRCIUJWPSRPQGINCCSXTHVRIOKLHH7GAJ42NNAERA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:11.897994899 (243h30m36.665678325s) [noise=true , address=81.171.14.70:4025 , piece_id=TAKEHN75NX6RFEFRR5532A6AQJRBCS4REDGNAXJNWQMFWS6EQSWQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:13.995171303 (243h30m38.762854732s) [noise=true , address=81.171.14.70:4036 , piece_id=4KINF6GWQFNK7SEJBXVXTMKMFHWVZ4RRBMBONJEV74AHOYINAI3Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:14.620057026 (243h30m39.38774045s) [noise=true , address=81.171.14.70:4029 , piece_id=2ECO7GGZMVJPC5R6ADCLHXR7BHG5GAJJ5IQ7AIZQ4ND2YL6KR2SA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:15.624633590 (243h30m40.392317019s) [noise=true , address=81.171.14.70:4028 , piece_id=INCSZCH2ZA23DSDXGXBHICU4YMNGTCDNFISNI2SNADPEKOE4I2RQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: read tcp 159.223.143.39:42198->81.171.14.70:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.624764414 (243h30m40.39244785s) [noise=true , address=81.171.14.70:4042 , piece_id=7YOGQYMBBQF3R2AALKZXLJUL5VJII5WMFLUKEUAYTLMLGTIJGDIQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: rpc: dial tcp 81.171.14.70:4042: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.624817700 (243h30m40.392501134s) [noise=true , address=81.171.14.70:4043 , piece_id=FQ5SR76KXNGIBI2T7AK3XFLN57YO4H5RBAAESPICBOL2L2FCWHBQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:41532->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625114736 (243h30m40.392798172s) [noise=true , address=81.171.14.70:4045 , piece_id=JC5POJW2ZGLZB6OFTPLS3PK3LAK6AE6SICLVYYP74RY3Z4KQE7IA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: read tcp 159.223.143.39:49638->81.171.14.70:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625409951 (243h30m40.393093382s) [noise=true , address=81.171.14.70:4047 , piece_id=VQN2T44TCUUMBDS23NHRBM2RO5F6TC4WGNQPL4DDRU3A6DQTMBEA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:40864->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625456822 (243h30m40.393140242s) [seg_pos={0 0}, upload=253234]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 21 13:17:15.727844444 (243h30m40.495527869s) [upload=253234]: Done uploading segments... Nov 21 13:17:15.727891684 (243h30m40.495575113s) [upload=253234]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 2.062815704s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.539686266s trace: https://jaeger.dev.storj.io/trace/3e276090513c6d3b FAIL (2025-11-21 13:25:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== 5L3BR7D5JBTEHIGBPAID5EJKUBYNETWMJWHJ5A, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.987498478 (243h29m40.755181917s) [noise=true , address=185.167.204.205:4031 , piece_id=IAZRVIE3YHQTNM22UYM4B7TCBYDA2EUMSNIK7C4R3637NTYHSLRQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.988154860 (243h29m40.755838308s) [noise=true , address=89.149.201.147:4009 , piece_id=BOG3EIF5CLQOJ4QOFVVOIYUVQH3YZBJJ5WKJ6BSE5WOF3NQMK5YA, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.988761968 (243h29m40.756445412s) [noise=true , address=185.167.204.206:4055 , piece_id=T2UM73BIH3KOT5XBVY3ZRQNQ672CPH57OKVVSVHVSFZU2D6PPTXQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.989455702 (243h29m40.757139137s) [noise=true , address=89.149.201.147:4021 , piece_id=ZHXGNV4M2G47UN3H6B2KLND3GBEHFIJ4ZDANVUBRX3SUQGTEFR2A, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.990168101 (243h29m40.757851537s) [noise=true , address=89.149.201.147:4018 , piece_id=2SATC6VJT4HHRCIUJWPSRPQGINCCSXTHVRIOKLHH7GAJ42NNAERA, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.990870219 (243h29m40.758553659s) [noise=true , address=185.167.204.206:4047 , piece_id=RIJHJETENKHV23KNYXZ5SSDOR5VLTSQ64IBSFSIKVCYB4SP35IOQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.991676123 (243h29m40.759359559s) [noise=true , address=81.171.14.70:4043 , piece_id=FQ5SR76KXNGIBI2T7AK3XFLN57YO4H5RBAAESPICBOL2L2FCWHBQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.993530722 (243h29m40.761214161s) [noise=true , address=185.167.204.205:4022 , piece_id=35QCU5FIDBUJQFNCJCHKWDDKGPPDXEDBKCNI5A5VMAS7NXZTTNGQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.995576845 (243h29m40.76326028s) [noise=true , address=81.171.14.70:4028 , piece_id=INCSZCH2ZA23DSDXGXBHICU4YMNGTCDNFISNI2SNADPEKOE4I2RQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:16.417071691 (243h29m41.184755117s) [upload=253234]: Next returned nil segment Nov 21 13:16:16.417088568 (243h29m41.184771994s) [upload=253234]: Waiting for error group managing segments... Nov 21 13:16:16.604253953 (243h29m41.37193741s) [noise=true , address=89.149.201.147:4009 , piece_id=BOG3EIF5CLQOJ4QOFVVOIYUVQH3YZBJJ5WKJ6BSE5WOF3NQMK5YA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.616631034 (243h29m41.384314459s) [noise=true , address=89.149.201.147:4022 , piece_id=S4CD6TBJIQGENSR3OUDZSFNUGEKCKG2KF6GS4DN3YAYF3FCK6BRQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.622248975 (243h29m41.389932404s) [noise=true , address=89.149.201.147:4021 , piece_id=ZHXGNV4M2G47UN3H6B2KLND3GBEHFIJ4ZDANVUBRX3SUQGTEFR2A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.622772397 (243h29m41.390455832s) [noise=true , address=89.149.201.147:4005 , piece_id=JVTLH6W7GNBKF6FI5K56GUKQ7LPWGSNZWV2X3TGFOHUKG2COXJDQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.635671178 (243h29m41.403354603s) [noise=true , address=185.167.204.206:4044 , piece_id=TJO4FHXPZWWLIISBTWLX2H4PDWFDGID2LWQAR7TAJGXM3OO6O73Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.638523014 (243h29m41.406206439s) [noise=true , address=185.167.204.206:4045 , piece_id=W26WUTNYVGHDZ6AA5BPGBRLTCXTS4DVWHYSW7ORP44BBJY7HVD2A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.647706039 (243h29m41.415389468s) [noise=true , address=185.167.204.205:4024 , piece_id=UQU4IGX45QTKY5SY5HEKRVCXDHK6PPYDZDTTKEHUDW6JETPQDUNA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.647997350 (243h29m41.415680775s) [noise=true , address=185.167.204.206:4058 , piece_id=75RVJDMPKHI56JQZBD7Y6NZYEWZCWILQM6IXOLHXFBX3ASOPAZCQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.650444384 (243h29m41.418127809s) [noise=true , address=185.167.204.205:4031 , piece_id=IAZRVIE3YHQTNM22UYM4B7TCBYDA2EUMSNIK7C4R3637NTYHSLRQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.651259970 (243h29m41.418943401s) [noise=true , address=185.167.204.206:4067 , piece_id=DYKO7IR5VSJGEYCEM672JGIDQGB4CIURDQ65FFZTC2TJCJCR4A7Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.653940496 (243h29m41.421623925s) [noise=true , address=185.167.204.205:4028 , piece_id=NUAIVIFVS3PIDLDP4I56II7GROUQ4N5HIGUUJLWEKDJM2HISQK7A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.656238559 (243h29m41.423921984s) [noise=true , address=185.167.204.205:4020 , piece_id=PVVA4UFQEOJNEJ2QXAIFREZEBJBSMOLCB7VVGOH5HR2NK4KELPYA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.658552874 (243h29m41.426236299s) [noise=true , address=185.167.204.206:4047 , piece_id=RIJHJETENKHV23KNYXZ5SSDOR5VLTSQ64IBSFSIKVCYB4SP35IOQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.658795439 (243h29m41.426478865s) [noise=true , address=185.167.204.206:4066 , piece_id=IJX27IPYXELRKHIBF3DLKORJ2IX55LRNAGPOUQEUZ3MPBN7FQCSQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.664043937 (243h29m41.431727378s) [noise=true , address=89.149.201.147:4001 , piece_id=6UMZWXB3BYCP6OZJOFREAYMD66PSUVZSNBBDRRYLWZSDDBAIHHYA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.664924438 (243h29m41.432607866s) [noise=true , address=185.167.204.206:4057 , piece_id=UZUKNSI26BGMZUWQULLZMIN7ZZNGVCYRLLFMNWT7KNLOD5GG65SQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.672162093 (243h29m41.439845519s) [noise=true , address=185.167.204.205:4022 , piece_id=35QCU5FIDBUJQFNCJCHKWDDKGPPDXEDBKCNI5A5VMAS7NXZTTNGQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.675169434 (243h29m41.44285286s) [noise=true , address=185.167.204.206:4063 , piece_id=LZ2MWIOS4OFWTV5L3BR7D5JBTEHIGBPAID5EJKUBYNETWMJWHJ5A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.676639209 (243h29m41.444322635s) [noise=true , address=185.167.204.206:4055 , piece_id=T2UM73BIH3KOT5XBVY3ZRQNQ672CPH57OKVVSVHVSFZU2D6PPTXQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.677425453 (243h29m41.445108879s) [noise=true , address=89.149.201.147:4018 , piece_id=2SATC6VJT4HHRCIUJWPSRPQGINCCSXTHVRIOKLHH7GAJ42NNAERA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:11.897994899 (243h30m36.665678325s) [noise=true , address=81.171.14.70:4025 , piece_id=TAKEHN75NX6RFEFRR5532A6AQJRBCS4REDGNAXJNWQMFWS6EQSWQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:13.995171303 (243h30m38.762854732s) [noise=true , address=81.171.14.70:4036 , piece_id=4KINF6GWQFNK7SEJBXVXTMKMFHWVZ4RRBMBONJEV74AHOYINAI3Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:14.620057026 (243h30m39.38774045s) [noise=true , address=81.171.14.70:4029 , piece_id=2ECO7GGZMVJPC5R6ADCLHXR7BHG5GAJJ5IQ7AIZQ4ND2YL6KR2SA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:15.624633590 (243h30m40.392317019s) [noise=true , address=81.171.14.70:4028 , piece_id=INCSZCH2ZA23DSDXGXBHICU4YMNGTCDNFISNI2SNADPEKOE4I2RQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: read tcp 159.223.143.39:42198->81.171.14.70:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.624764414 (243h30m40.39244785s) [noise=true , address=81.171.14.70:4042 , piece_id=7YOGQYMBBQF3R2AALKZXLJUL5VJII5WMFLUKEUAYTLMLGTIJGDIQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: rpc: dial tcp 81.171.14.70:4042: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.624817700 (243h30m40.392501134s) [noise=true , address=81.171.14.70:4043 , piece_id=FQ5SR76KXNGIBI2T7AK3XFLN57YO4H5RBAAESPICBOL2L2FCWHBQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:41532->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625114736 (243h30m40.392798172s) [noise=true , address=81.171.14.70:4045 , piece_id=JC5POJW2ZGLZB6OFTPLS3PK3LAK6AE6SICLVYYP74RY3Z4KQE7IA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: read tcp 159.223.143.39:49638->81.171.14.70:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625409951 (243h30m40.393093382s) [noise=true , address=81.171.14.70:4047 , piece_id=VQN2T44TCUUMBDS23NHRBM2RO5F6TC4WGNQPL4DDRU3A6DQTMBEA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:40864->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625456822 (243h30m40.393140242s) [seg_pos={0 0}, upload=253234]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 21 13:17:15.727844444 (243h30m40.495527869s) [upload=253234]: Done uploading segments... Nov 21 13:17:15.727891684 (243h30m40.495575113s) [upload=253234]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 2.539716605s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.101515373s trace: https://jaeger.dev.storj.io/trace/3e276090513c6d3b FAIL (2025-11-21 13:25:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== 5L3BR7D5JBTEHIGBPAID5EJKUBYNETWMJWHJ5A, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.987498478 (243h29m40.755181917s) [noise=true , address=185.167.204.205:4031 , piece_id=IAZRVIE3YHQTNM22UYM4B7TCBYDA2EUMSNIK7C4R3637NTYHSLRQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.988154860 (243h29m40.755838308s) [noise=true , address=89.149.201.147:4009 , piece_id=BOG3EIF5CLQOJ4QOFVVOIYUVQH3YZBJJ5WKJ6BSE5WOF3NQMK5YA, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.988761968 (243h29m40.756445412s) [noise=true , address=185.167.204.206:4055 , piece_id=T2UM73BIH3KOT5XBVY3ZRQNQ672CPH57OKVVSVHVSFZU2D6PPTXQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.989455702 (243h29m40.757139137s) [noise=true , address=89.149.201.147:4021 , piece_id=ZHXGNV4M2G47UN3H6B2KLND3GBEHFIJ4ZDANVUBRX3SUQGTEFR2A, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.990168101 (243h29m40.757851537s) [noise=true , address=89.149.201.147:4018 , piece_id=2SATC6VJT4HHRCIUJWPSRPQGINCCSXTHVRIOKLHH7GAJ42NNAERA, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.990870219 (243h29m40.758553659s) [noise=true , address=185.167.204.206:4047 , piece_id=RIJHJETENKHV23KNYXZ5SSDOR5VLTSQ64IBSFSIKVCYB4SP35IOQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.991676123 (243h29m40.759359559s) [noise=true , address=81.171.14.70:4043 , piece_id=FQ5SR76KXNGIBI2T7AK3XFLN57YO4H5RBAAESPICBOL2L2FCWHBQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.993530722 (243h29m40.761214161s) [noise=true , address=185.167.204.205:4022 , piece_id=35QCU5FIDBUJQFNCJCHKWDDKGPPDXEDBKCNI5A5VMAS7NXZTTNGQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.995576845 (243h29m40.76326028s) [noise=true , address=81.171.14.70:4028 , piece_id=INCSZCH2ZA23DSDXGXBHICU4YMNGTCDNFISNI2SNADPEKOE4I2RQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:16.417071691 (243h29m41.184755117s) [upload=253234]: Next returned nil segment Nov 21 13:16:16.417088568 (243h29m41.184771994s) [upload=253234]: Waiting for error group managing segments... Nov 21 13:16:16.604253953 (243h29m41.37193741s) [noise=true , address=89.149.201.147:4009 , piece_id=BOG3EIF5CLQOJ4QOFVVOIYUVQH3YZBJJ5WKJ6BSE5WOF3NQMK5YA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.616631034 (243h29m41.384314459s) [noise=true , address=89.149.201.147:4022 , piece_id=S4CD6TBJIQGENSR3OUDZSFNUGEKCKG2KF6GS4DN3YAYF3FCK6BRQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.622248975 (243h29m41.389932404s) [noise=true , address=89.149.201.147:4021 , piece_id=ZHXGNV4M2G47UN3H6B2KLND3GBEHFIJ4ZDANVUBRX3SUQGTEFR2A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.622772397 (243h29m41.390455832s) [noise=true , address=89.149.201.147:4005 , piece_id=JVTLH6W7GNBKF6FI5K56GUKQ7LPWGSNZWV2X3TGFOHUKG2COXJDQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.635671178 (243h29m41.403354603s) [noise=true , address=185.167.204.206:4044 , piece_id=TJO4FHXPZWWLIISBTWLX2H4PDWFDGID2LWQAR7TAJGXM3OO6O73Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.638523014 (243h29m41.406206439s) [noise=true , address=185.167.204.206:4045 , piece_id=W26WUTNYVGHDZ6AA5BPGBRLTCXTS4DVWHYSW7ORP44BBJY7HVD2A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.647706039 (243h29m41.415389468s) [noise=true , address=185.167.204.205:4024 , piece_id=UQU4IGX45QTKY5SY5HEKRVCXDHK6PPYDZDTTKEHUDW6JETPQDUNA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.647997350 (243h29m41.415680775s) [noise=true , address=185.167.204.206:4058 , piece_id=75RVJDMPKHI56JQZBD7Y6NZYEWZCWILQM6IXOLHXFBX3ASOPAZCQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.650444384 (243h29m41.418127809s) [noise=true , address=185.167.204.205:4031 , piece_id=IAZRVIE3YHQTNM22UYM4B7TCBYDA2EUMSNIK7C4R3637NTYHSLRQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.651259970 (243h29m41.418943401s) [noise=true , address=185.167.204.206:4067 , piece_id=DYKO7IR5VSJGEYCEM672JGIDQGB4CIURDQ65FFZTC2TJCJCR4A7Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.653940496 (243h29m41.421623925s) [noise=true , address=185.167.204.205:4028 , piece_id=NUAIVIFVS3PIDLDP4I56II7GROUQ4N5HIGUUJLWEKDJM2HISQK7A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.656238559 (243h29m41.423921984s) [noise=true , address=185.167.204.205:4020 , piece_id=PVVA4UFQEOJNEJ2QXAIFREZEBJBSMOLCB7VVGOH5HR2NK4KELPYA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.658552874 (243h29m41.426236299s) [noise=true , address=185.167.204.206:4047 , piece_id=RIJHJETENKHV23KNYXZ5SSDOR5VLTSQ64IBSFSIKVCYB4SP35IOQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.658795439 (243h29m41.426478865s) [noise=true , address=185.167.204.206:4066 , piece_id=IJX27IPYXELRKHIBF3DLKORJ2IX55LRNAGPOUQEUZ3MPBN7FQCSQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.664043937 (243h29m41.431727378s) [noise=true , address=89.149.201.147:4001 , piece_id=6UMZWXB3BYCP6OZJOFREAYMD66PSUVZSNBBDRRYLWZSDDBAIHHYA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.664924438 (243h29m41.432607866s) [noise=true , address=185.167.204.206:4057 , piece_id=UZUKNSI26BGMZUWQULLZMIN7ZZNGVCYRLLFMNWT7KNLOD5GG65SQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.672162093 (243h29m41.439845519s) [noise=true , address=185.167.204.205:4022 , piece_id=35QCU5FIDBUJQFNCJCHKWDDKGPPDXEDBKCNI5A5VMAS7NXZTTNGQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.675169434 (243h29m41.44285286s) [noise=true , address=185.167.204.206:4063 , piece_id=LZ2MWIOS4OFWTV5L3BR7D5JBTEHIGBPAID5EJKUBYNETWMJWHJ5A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.676639209 (243h29m41.444322635s) [noise=true , address=185.167.204.206:4055 , piece_id=T2UM73BIH3KOT5XBVY3ZRQNQ672CPH57OKVVSVHVSFZU2D6PPTXQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.677425453 (243h29m41.445108879s) [noise=true , address=89.149.201.147:4018 , piece_id=2SATC6VJT4HHRCIUJWPSRPQGINCCSXTHVRIOKLHH7GAJ42NNAERA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:11.897994899 (243h30m36.665678325s) [noise=true , address=81.171.14.70:4025 , piece_id=TAKEHN75NX6RFEFRR5532A6AQJRBCS4REDGNAXJNWQMFWS6EQSWQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:13.995171303 (243h30m38.762854732s) [noise=true , address=81.171.14.70:4036 , piece_id=4KINF6GWQFNK7SEJBXVXTMKMFHWVZ4RRBMBONJEV74AHOYINAI3Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:14.620057026 (243h30m39.38774045s) [noise=true , address=81.171.14.70:4029 , piece_id=2ECO7GGZMVJPC5R6ADCLHXR7BHG5GAJJ5IQ7AIZQ4ND2YL6KR2SA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:15.624633590 (243h30m40.392317019s) [noise=true , address=81.171.14.70:4028 , piece_id=INCSZCH2ZA23DSDXGXBHICU4YMNGTCDNFISNI2SNADPEKOE4I2RQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: read tcp 159.223.143.39:42198->81.171.14.70:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.624764414 (243h30m40.39244785s) [noise=true , address=81.171.14.70:4042 , piece_id=7YOGQYMBBQF3R2AALKZXLJUL5VJII5WMFLUKEUAYTLMLGTIJGDIQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: rpc: dial tcp 81.171.14.70:4042: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.624817700 (243h30m40.392501134s) [noise=true , address=81.171.14.70:4043 , piece_id=FQ5SR76KXNGIBI2T7AK3XFLN57YO4H5RBAAESPICBOL2L2FCWHBQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:41532->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625114736 (243h30m40.392798172s) [noise=true , address=81.171.14.70:4045 , piece_id=JC5POJW2ZGLZB6OFTPLS3PK3LAK6AE6SICLVYYP74RY3Z4KQE7IA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: read tcp 159.223.143.39:49638->81.171.14.70:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625409951 (243h30m40.393093382s) [noise=true , address=81.171.14.70:4047 , piece_id=VQN2T44TCUUMBDS23NHRBM2RO5F6TC4WGNQPL4DDRU3A6DQTMBEA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:40864->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625456822 (243h30m40.393140242s) [seg_pos={0 0}, upload=253234]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 21 13:17:15.727844444 (243h30m40.495527869s) [upload=253234]: Done uploading segments... Nov 21 13:17:15.727891684 (243h30m40.495575113s) [upload=253234]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 2.1015445s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 27.261867427s trace: https://jaeger.dev.storj.io/trace/3e276090513c6d3b FAIL (2025-11-21 13:24:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== 5L3BR7D5JBTEHIGBPAID5EJKUBYNETWMJWHJ5A, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.987498478 (243h29m40.755181917s) [noise=true , address=185.167.204.205:4031 , piece_id=IAZRVIE3YHQTNM22UYM4B7TCBYDA2EUMSNIK7C4R3637NTYHSLRQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.988154860 (243h29m40.755838308s) [noise=true , address=89.149.201.147:4009 , piece_id=BOG3EIF5CLQOJ4QOFVVOIYUVQH3YZBJJ5WKJ6BSE5WOF3NQMK5YA, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.988761968 (243h29m40.756445412s) [noise=true , address=185.167.204.206:4055 , piece_id=T2UM73BIH3KOT5XBVY3ZRQNQ672CPH57OKVVSVHVSFZU2D6PPTXQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.989455702 (243h29m40.757139137s) [noise=true , address=89.149.201.147:4021 , piece_id=ZHXGNV4M2G47UN3H6B2KLND3GBEHFIJ4ZDANVUBRX3SUQGTEFR2A, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.990168101 (243h29m40.757851537s) [noise=true , address=89.149.201.147:4018 , piece_id=2SATC6VJT4HHRCIUJWPSRPQGINCCSXTHVRIOKLHH7GAJ42NNAERA, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.990870219 (243h29m40.758553659s) [noise=true , address=185.167.204.206:4047 , piece_id=RIJHJETENKHV23KNYXZ5SSDOR5VLTSQ64IBSFSIKVCYB4SP35IOQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.991676123 (243h29m40.759359559s) [noise=true , address=81.171.14.70:4043 , piece_id=FQ5SR76KXNGIBI2T7AK3XFLN57YO4H5RBAAESPICBOL2L2FCWHBQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.993530722 (243h29m40.761214161s) [noise=true , address=185.167.204.205:4022 , piece_id=35QCU5FIDBUJQFNCJCHKWDDKGPPDXEDBKCNI5A5VMAS7NXZTTNGQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.995576845 (243h29m40.76326028s) [noise=true , address=81.171.14.70:4028 , piece_id=INCSZCH2ZA23DSDXGXBHICU4YMNGTCDNFISNI2SNADPEKOE4I2RQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:16.417071691 (243h29m41.184755117s) [upload=253234]: Next returned nil segment Nov 21 13:16:16.417088568 (243h29m41.184771994s) [upload=253234]: Waiting for error group managing segments... Nov 21 13:16:16.604253953 (243h29m41.37193741s) [noise=true , address=89.149.201.147:4009 , piece_id=BOG3EIF5CLQOJ4QOFVVOIYUVQH3YZBJJ5WKJ6BSE5WOF3NQMK5YA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.616631034 (243h29m41.384314459s) [noise=true , address=89.149.201.147:4022 , piece_id=S4CD6TBJIQGENSR3OUDZSFNUGEKCKG2KF6GS4DN3YAYF3FCK6BRQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.622248975 (243h29m41.389932404s) [noise=true , address=89.149.201.147:4021 , piece_id=ZHXGNV4M2G47UN3H6B2KLND3GBEHFIJ4ZDANVUBRX3SUQGTEFR2A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.622772397 (243h29m41.390455832s) [noise=true , address=89.149.201.147:4005 , piece_id=JVTLH6W7GNBKF6FI5K56GUKQ7LPWGSNZWV2X3TGFOHUKG2COXJDQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.635671178 (243h29m41.403354603s) [noise=true , address=185.167.204.206:4044 , piece_id=TJO4FHXPZWWLIISBTWLX2H4PDWFDGID2LWQAR7TAJGXM3OO6O73Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.638523014 (243h29m41.406206439s) [noise=true , address=185.167.204.206:4045 , piece_id=W26WUTNYVGHDZ6AA5BPGBRLTCXTS4DVWHYSW7ORP44BBJY7HVD2A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.647706039 (243h29m41.415389468s) [noise=true , address=185.167.204.205:4024 , piece_id=UQU4IGX45QTKY5SY5HEKRVCXDHK6PPYDZDTTKEHUDW6JETPQDUNA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.647997350 (243h29m41.415680775s) [noise=true , address=185.167.204.206:4058 , piece_id=75RVJDMPKHI56JQZBD7Y6NZYEWZCWILQM6IXOLHXFBX3ASOPAZCQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.650444384 (243h29m41.418127809s) [noise=true , address=185.167.204.205:4031 , piece_id=IAZRVIE3YHQTNM22UYM4B7TCBYDA2EUMSNIK7C4R3637NTYHSLRQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.651259970 (243h29m41.418943401s) [noise=true , address=185.167.204.206:4067 , piece_id=DYKO7IR5VSJGEYCEM672JGIDQGB4CIURDQ65FFZTC2TJCJCR4A7Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.653940496 (243h29m41.421623925s) [noise=true , address=185.167.204.205:4028 , piece_id=NUAIVIFVS3PIDLDP4I56II7GROUQ4N5HIGUUJLWEKDJM2HISQK7A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.656238559 (243h29m41.423921984s) [noise=true , address=185.167.204.205:4020 , piece_id=PVVA4UFQEOJNEJ2QXAIFREZEBJBSMOLCB7VVGOH5HR2NK4KELPYA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.658552874 (243h29m41.426236299s) [noise=true , address=185.167.204.206:4047 , piece_id=RIJHJETENKHV23KNYXZ5SSDOR5VLTSQ64IBSFSIKVCYB4SP35IOQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.658795439 (243h29m41.426478865s) [noise=true , address=185.167.204.206:4066 , piece_id=IJX27IPYXELRKHIBF3DLKORJ2IX55LRNAGPOUQEUZ3MPBN7FQCSQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.664043937 (243h29m41.431727378s) [noise=true , address=89.149.201.147:4001 , piece_id=6UMZWXB3BYCP6OZJOFREAYMD66PSUVZSNBBDRRYLWZSDDBAIHHYA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.664924438 (243h29m41.432607866s) [noise=true , address=185.167.204.206:4057 , piece_id=UZUKNSI26BGMZUWQULLZMIN7ZZNGVCYRLLFMNWT7KNLOD5GG65SQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.672162093 (243h29m41.439845519s) [noise=true , address=185.167.204.205:4022 , piece_id=35QCU5FIDBUJQFNCJCHKWDDKGPPDXEDBKCNI5A5VMAS7NXZTTNGQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.675169434 (243h29m41.44285286s) [noise=true , address=185.167.204.206:4063 , piece_id=LZ2MWIOS4OFWTV5L3BR7D5JBTEHIGBPAID5EJKUBYNETWMJWHJ5A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.676639209 (243h29m41.444322635s) [noise=true , address=185.167.204.206:4055 , piece_id=T2UM73BIH3KOT5XBVY3ZRQNQ672CPH57OKVVSVHVSFZU2D6PPTXQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.677425453 (243h29m41.445108879s) [noise=true , address=89.149.201.147:4018 , piece_id=2SATC6VJT4HHRCIUJWPSRPQGINCCSXTHVRIOKLHH7GAJ42NNAERA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:11.897994899 (243h30m36.665678325s) [noise=true , address=81.171.14.70:4025 , piece_id=TAKEHN75NX6RFEFRR5532A6AQJRBCS4REDGNAXJNWQMFWS6EQSWQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:13.995171303 (243h30m38.762854732s) [noise=true , address=81.171.14.70:4036 , piece_id=4KINF6GWQFNK7SEJBXVXTMKMFHWVZ4RRBMBONJEV74AHOYINAI3Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:14.620057026 (243h30m39.38774045s) [noise=true , address=81.171.14.70:4029 , piece_id=2ECO7GGZMVJPC5R6ADCLHXR7BHG5GAJJ5IQ7AIZQ4ND2YL6KR2SA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:15.624633590 (243h30m40.392317019s) [noise=true , address=81.171.14.70:4028 , piece_id=INCSZCH2ZA23DSDXGXBHICU4YMNGTCDNFISNI2SNADPEKOE4I2RQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: read tcp 159.223.143.39:42198->81.171.14.70:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.624764414 (243h30m40.39244785s) [noise=true , address=81.171.14.70:4042 , piece_id=7YOGQYMBBQF3R2AALKZXLJUL5VJII5WMFLUKEUAYTLMLGTIJGDIQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: rpc: dial tcp 81.171.14.70:4042: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.624817700 (243h30m40.392501134s) [noise=true , address=81.171.14.70:4043 , piece_id=FQ5SR76KXNGIBI2T7AK3XFLN57YO4H5RBAAESPICBOL2L2FCWHBQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:41532->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625114736 (243h30m40.392798172s) [noise=true , address=81.171.14.70:4045 , piece_id=JC5POJW2ZGLZB6OFTPLS3PK3LAK6AE6SICLVYYP74RY3Z4KQE7IA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: read tcp 159.223.143.39:49638->81.171.14.70:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625409951 (243h30m40.393093382s) [noise=true , address=81.171.14.70:4047 , piece_id=VQN2T44TCUUMBDS23NHRBM2RO5F6TC4WGNQPL4DDRU3A6DQTMBEA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:40864->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625456822 (243h30m40.393140242s) [seg_pos={0 0}, upload=253234]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 21 13:17:15.727844444 (243h30m40.495527869s) [upload=253234]: Done uploading segments... Nov 21 13:17:15.727891684 (243h30m40.495575113s) [upload=253234]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 27.261882208s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.118011594s trace: https://jaeger.dev.storj.io/trace/3e276090513c6d3b FAIL (2025-11-21 13:23:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== 5L3BR7D5JBTEHIGBPAID5EJKUBYNETWMJWHJ5A, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.987498478 (243h29m40.755181917s) [noise=true , address=185.167.204.205:4031 , piece_id=IAZRVIE3YHQTNM22UYM4B7TCBYDA2EUMSNIK7C4R3637NTYHSLRQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.988154860 (243h29m40.755838308s) [noise=true , address=89.149.201.147:4009 , piece_id=BOG3EIF5CLQOJ4QOFVVOIYUVQH3YZBJJ5WKJ6BSE5WOF3NQMK5YA, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.988761968 (243h29m40.756445412s) [noise=true , address=185.167.204.206:4055 , piece_id=T2UM73BIH3KOT5XBVY3ZRQNQ672CPH57OKVVSVHVSFZU2D6PPTXQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.989455702 (243h29m40.757139137s) [noise=true , address=89.149.201.147:4021 , piece_id=ZHXGNV4M2G47UN3H6B2KLND3GBEHFIJ4ZDANVUBRX3SUQGTEFR2A, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.990168101 (243h29m40.757851537s) [noise=true , address=89.149.201.147:4018 , piece_id=2SATC6VJT4HHRCIUJWPSRPQGINCCSXTHVRIOKLHH7GAJ42NNAERA, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.990870219 (243h29m40.758553659s) [noise=true , address=185.167.204.206:4047 , piece_id=RIJHJETENKHV23KNYXZ5SSDOR5VLTSQ64IBSFSIKVCYB4SP35IOQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.991676123 (243h29m40.759359559s) [noise=true , address=81.171.14.70:4043 , piece_id=FQ5SR76KXNGIBI2T7AK3XFLN57YO4H5RBAAESPICBOL2L2FCWHBQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.993530722 (243h29m40.761214161s) [noise=true , address=185.167.204.205:4022 , piece_id=35QCU5FIDBUJQFNCJCHKWDDKGPPDXEDBKCNI5A5VMAS7NXZTTNGQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.995576845 (243h29m40.76326028s) [noise=true , address=81.171.14.70:4028 , piece_id=INCSZCH2ZA23DSDXGXBHICU4YMNGTCDNFISNI2SNADPEKOE4I2RQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:16.417071691 (243h29m41.184755117s) [upload=253234]: Next returned nil segment Nov 21 13:16:16.417088568 (243h29m41.184771994s) [upload=253234]: Waiting for error group managing segments... Nov 21 13:16:16.604253953 (243h29m41.37193741s) [noise=true , address=89.149.201.147:4009 , piece_id=BOG3EIF5CLQOJ4QOFVVOIYUVQH3YZBJJ5WKJ6BSE5WOF3NQMK5YA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.616631034 (243h29m41.384314459s) [noise=true , address=89.149.201.147:4022 , piece_id=S4CD6TBJIQGENSR3OUDZSFNUGEKCKG2KF6GS4DN3YAYF3FCK6BRQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.622248975 (243h29m41.389932404s) [noise=true , address=89.149.201.147:4021 , piece_id=ZHXGNV4M2G47UN3H6B2KLND3GBEHFIJ4ZDANVUBRX3SUQGTEFR2A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.622772397 (243h29m41.390455832s) [noise=true , address=89.149.201.147:4005 , piece_id=JVTLH6W7GNBKF6FI5K56GUKQ7LPWGSNZWV2X3TGFOHUKG2COXJDQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.635671178 (243h29m41.403354603s) [noise=true , address=185.167.204.206:4044 , piece_id=TJO4FHXPZWWLIISBTWLX2H4PDWFDGID2LWQAR7TAJGXM3OO6O73Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.638523014 (243h29m41.406206439s) [noise=true , address=185.167.204.206:4045 , piece_id=W26WUTNYVGHDZ6AA5BPGBRLTCXTS4DVWHYSW7ORP44BBJY7HVD2A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.647706039 (243h29m41.415389468s) [noise=true , address=185.167.204.205:4024 , piece_id=UQU4IGX45QTKY5SY5HEKRVCXDHK6PPYDZDTTKEHUDW6JETPQDUNA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.647997350 (243h29m41.415680775s) [noise=true , address=185.167.204.206:4058 , piece_id=75RVJDMPKHI56JQZBD7Y6NZYEWZCWILQM6IXOLHXFBX3ASOPAZCQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.650444384 (243h29m41.418127809s) [noise=true , address=185.167.204.205:4031 , piece_id=IAZRVIE3YHQTNM22UYM4B7TCBYDA2EUMSNIK7C4R3637NTYHSLRQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.651259970 (243h29m41.418943401s) [noise=true , address=185.167.204.206:4067 , piece_id=DYKO7IR5VSJGEYCEM672JGIDQGB4CIURDQ65FFZTC2TJCJCR4A7Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.653940496 (243h29m41.421623925s) [noise=true , address=185.167.204.205:4028 , piece_id=NUAIVIFVS3PIDLDP4I56II7GROUQ4N5HIGUUJLWEKDJM2HISQK7A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.656238559 (243h29m41.423921984s) [noise=true , address=185.167.204.205:4020 , piece_id=PVVA4UFQEOJNEJ2QXAIFREZEBJBSMOLCB7VVGOH5HR2NK4KELPYA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.658552874 (243h29m41.426236299s) [noise=true , address=185.167.204.206:4047 , piece_id=RIJHJETENKHV23KNYXZ5SSDOR5VLTSQ64IBSFSIKVCYB4SP35IOQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.658795439 (243h29m41.426478865s) [noise=true , address=185.167.204.206:4066 , piece_id=IJX27IPYXELRKHIBF3DLKORJ2IX55LRNAGPOUQEUZ3MPBN7FQCSQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.664043937 (243h29m41.431727378s) [noise=true , address=89.149.201.147:4001 , piece_id=6UMZWXB3BYCP6OZJOFREAYMD66PSUVZSNBBDRRYLWZSDDBAIHHYA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.664924438 (243h29m41.432607866s) [noise=true , address=185.167.204.206:4057 , piece_id=UZUKNSI26BGMZUWQULLZMIN7ZZNGVCYRLLFMNWT7KNLOD5GG65SQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.672162093 (243h29m41.439845519s) [noise=true , address=185.167.204.205:4022 , piece_id=35QCU5FIDBUJQFNCJCHKWDDKGPPDXEDBKCNI5A5VMAS7NXZTTNGQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.675169434 (243h29m41.44285286s) [noise=true , address=185.167.204.206:4063 , piece_id=LZ2MWIOS4OFWTV5L3BR7D5JBTEHIGBPAID5EJKUBYNETWMJWHJ5A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.676639209 (243h29m41.444322635s) [noise=true , address=185.167.204.206:4055 , piece_id=T2UM73BIH3KOT5XBVY3ZRQNQ672CPH57OKVVSVHVSFZU2D6PPTXQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.677425453 (243h29m41.445108879s) [noise=true , address=89.149.201.147:4018 , piece_id=2SATC6VJT4HHRCIUJWPSRPQGINCCSXTHVRIOKLHH7GAJ42NNAERA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:11.897994899 (243h30m36.665678325s) [noise=true , address=81.171.14.70:4025 , piece_id=TAKEHN75NX6RFEFRR5532A6AQJRBCS4REDGNAXJNWQMFWS6EQSWQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:13.995171303 (243h30m38.762854732s) [noise=true , address=81.171.14.70:4036 , piece_id=4KINF6GWQFNK7SEJBXVXTMKMFHWVZ4RRBMBONJEV74AHOYINAI3Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:14.620057026 (243h30m39.38774045s) [noise=true , address=81.171.14.70:4029 , piece_id=2ECO7GGZMVJPC5R6ADCLHXR7BHG5GAJJ5IQ7AIZQ4ND2YL6KR2SA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:15.624633590 (243h30m40.392317019s) [noise=true , address=81.171.14.70:4028 , piece_id=INCSZCH2ZA23DSDXGXBHICU4YMNGTCDNFISNI2SNADPEKOE4I2RQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: read tcp 159.223.143.39:42198->81.171.14.70:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.624764414 (243h30m40.39244785s) [noise=true , address=81.171.14.70:4042 , piece_id=7YOGQYMBBQF3R2AALKZXLJUL5VJII5WMFLUKEUAYTLMLGTIJGDIQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: rpc: dial tcp 81.171.14.70:4042: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.624817700 (243h30m40.392501134s) [noise=true , address=81.171.14.70:4043 , piece_id=FQ5SR76KXNGIBI2T7AK3XFLN57YO4H5RBAAESPICBOL2L2FCWHBQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:41532->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625114736 (243h30m40.392798172s) [noise=true , address=81.171.14.70:4045 , piece_id=JC5POJW2ZGLZB6OFTPLS3PK3LAK6AE6SICLVYYP74RY3Z4KQE7IA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: read tcp 159.223.143.39:49638->81.171.14.70:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625409951 (243h30m40.393093382s) [noise=true , address=81.171.14.70:4047 , piece_id=VQN2T44TCUUMBDS23NHRBM2RO5F6TC4WGNQPL4DDRU3A6DQTMBEA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:40864->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625456822 (243h30m40.393140242s) [seg_pos={0 0}, upload=253234]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 21 13:17:15.727844444 (243h30m40.495527869s) [upload=253234]: Done uploading segments... Nov 21 13:17:15.727891684 (243h30m40.495575113s) [upload=253234]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 2.118048242s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.086636611s trace: https://jaeger.dev.storj.io/trace/3e276090513c6d3b FAIL (2025-11-21 13:22:55 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== 5L3BR7D5JBTEHIGBPAID5EJKUBYNETWMJWHJ5A, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.987498478 (243h29m40.755181917s) [noise=true , address=185.167.204.205:4031 , piece_id=IAZRVIE3YHQTNM22UYM4B7TCBYDA2EUMSNIK7C4R3637NTYHSLRQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.988154860 (243h29m40.755838308s) [noise=true , address=89.149.201.147:4009 , piece_id=BOG3EIF5CLQOJ4QOFVVOIYUVQH3YZBJJ5WKJ6BSE5WOF3NQMK5YA, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.988761968 (243h29m40.756445412s) [noise=true , address=185.167.204.206:4055 , piece_id=T2UM73BIH3KOT5XBVY3ZRQNQ672CPH57OKVVSVHVSFZU2D6PPTXQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.989455702 (243h29m40.757139137s) [noise=true , address=89.149.201.147:4021 , piece_id=ZHXGNV4M2G47UN3H6B2KLND3GBEHFIJ4ZDANVUBRX3SUQGTEFR2A, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.990168101 (243h29m40.757851537s) [noise=true , address=89.149.201.147:4018 , piece_id=2SATC6VJT4HHRCIUJWPSRPQGINCCSXTHVRIOKLHH7GAJ42NNAERA, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.990870219 (243h29m40.758553659s) [noise=true , address=185.167.204.206:4047 , piece_id=RIJHJETENKHV23KNYXZ5SSDOR5VLTSQ64IBSFSIKVCYB4SP35IOQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.991676123 (243h29m40.759359559s) [noise=true , address=81.171.14.70:4043 , piece_id=FQ5SR76KXNGIBI2T7AK3XFLN57YO4H5RBAAESPICBOL2L2FCWHBQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.993530722 (243h29m40.761214161s) [noise=true , address=185.167.204.205:4022 , piece_id=35QCU5FIDBUJQFNCJCHKWDDKGPPDXEDBKCNI5A5VMAS7NXZTTNGQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.995576845 (243h29m40.76326028s) [noise=true , address=81.171.14.70:4028 , piece_id=INCSZCH2ZA23DSDXGXBHICU4YMNGTCDNFISNI2SNADPEKOE4I2RQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:16.417071691 (243h29m41.184755117s) [upload=253234]: Next returned nil segment Nov 21 13:16:16.417088568 (243h29m41.184771994s) [upload=253234]: Waiting for error group managing segments... Nov 21 13:16:16.604253953 (243h29m41.37193741s) [noise=true , address=89.149.201.147:4009 , piece_id=BOG3EIF5CLQOJ4QOFVVOIYUVQH3YZBJJ5WKJ6BSE5WOF3NQMK5YA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.616631034 (243h29m41.384314459s) [noise=true , address=89.149.201.147:4022 , piece_id=S4CD6TBJIQGENSR3OUDZSFNUGEKCKG2KF6GS4DN3YAYF3FCK6BRQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.622248975 (243h29m41.389932404s) [noise=true , address=89.149.201.147:4021 , piece_id=ZHXGNV4M2G47UN3H6B2KLND3GBEHFIJ4ZDANVUBRX3SUQGTEFR2A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.622772397 (243h29m41.390455832s) [noise=true , address=89.149.201.147:4005 , piece_id=JVTLH6W7GNBKF6FI5K56GUKQ7LPWGSNZWV2X3TGFOHUKG2COXJDQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.635671178 (243h29m41.403354603s) [noise=true , address=185.167.204.206:4044 , piece_id=TJO4FHXPZWWLIISBTWLX2H4PDWFDGID2LWQAR7TAJGXM3OO6O73Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.638523014 (243h29m41.406206439s) [noise=true , address=185.167.204.206:4045 , piece_id=W26WUTNYVGHDZ6AA5BPGBRLTCXTS4DVWHYSW7ORP44BBJY7HVD2A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.647706039 (243h29m41.415389468s) [noise=true , address=185.167.204.205:4024 , piece_id=UQU4IGX45QTKY5SY5HEKRVCXDHK6PPYDZDTTKEHUDW6JETPQDUNA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.647997350 (243h29m41.415680775s) [noise=true , address=185.167.204.206:4058 , piece_id=75RVJDMPKHI56JQZBD7Y6NZYEWZCWILQM6IXOLHXFBX3ASOPAZCQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.650444384 (243h29m41.418127809s) [noise=true , address=185.167.204.205:4031 , piece_id=IAZRVIE3YHQTNM22UYM4B7TCBYDA2EUMSNIK7C4R3637NTYHSLRQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.651259970 (243h29m41.418943401s) [noise=true , address=185.167.204.206:4067 , piece_id=DYKO7IR5VSJGEYCEM672JGIDQGB4CIURDQ65FFZTC2TJCJCR4A7Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.653940496 (243h29m41.421623925s) [noise=true , address=185.167.204.205:4028 , piece_id=NUAIVIFVS3PIDLDP4I56II7GROUQ4N5HIGUUJLWEKDJM2HISQK7A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.656238559 (243h29m41.423921984s) [noise=true , address=185.167.204.205:4020 , piece_id=PVVA4UFQEOJNEJ2QXAIFREZEBJBSMOLCB7VVGOH5HR2NK4KELPYA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.658552874 (243h29m41.426236299s) [noise=true , address=185.167.204.206:4047 , piece_id=RIJHJETENKHV23KNYXZ5SSDOR5VLTSQ64IBSFSIKVCYB4SP35IOQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.658795439 (243h29m41.426478865s) [noise=true , address=185.167.204.206:4066 , piece_id=IJX27IPYXELRKHIBF3DLKORJ2IX55LRNAGPOUQEUZ3MPBN7FQCSQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.664043937 (243h29m41.431727378s) [noise=true , address=89.149.201.147:4001 , piece_id=6UMZWXB3BYCP6OZJOFREAYMD66PSUVZSNBBDRRYLWZSDDBAIHHYA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.664924438 (243h29m41.432607866s) [noise=true , address=185.167.204.206:4057 , piece_id=UZUKNSI26BGMZUWQULLZMIN7ZZNGVCYRLLFMNWT7KNLOD5GG65SQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.672162093 (243h29m41.439845519s) [noise=true , address=185.167.204.205:4022 , piece_id=35QCU5FIDBUJQFNCJCHKWDDKGPPDXEDBKCNI5A5VMAS7NXZTTNGQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.675169434 (243h29m41.44285286s) [noise=true , address=185.167.204.206:4063 , piece_id=LZ2MWIOS4OFWTV5L3BR7D5JBTEHIGBPAID5EJKUBYNETWMJWHJ5A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.676639209 (243h29m41.444322635s) [noise=true , address=185.167.204.206:4055 , piece_id=T2UM73BIH3KOT5XBVY3ZRQNQ672CPH57OKVVSVHVSFZU2D6PPTXQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.677425453 (243h29m41.445108879s) [noise=true , address=89.149.201.147:4018 , piece_id=2SATC6VJT4HHRCIUJWPSRPQGINCCSXTHVRIOKLHH7GAJ42NNAERA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:11.897994899 (243h30m36.665678325s) [noise=true , address=81.171.14.70:4025 , piece_id=TAKEHN75NX6RFEFRR5532A6AQJRBCS4REDGNAXJNWQMFWS6EQSWQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:13.995171303 (243h30m38.762854732s) [noise=true , address=81.171.14.70:4036 , piece_id=4KINF6GWQFNK7SEJBXVXTMKMFHWVZ4RRBMBONJEV74AHOYINAI3Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:14.620057026 (243h30m39.38774045s) [noise=true , address=81.171.14.70:4029 , piece_id=2ECO7GGZMVJPC5R6ADCLHXR7BHG5GAJJ5IQ7AIZQ4ND2YL6KR2SA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:15.624633590 (243h30m40.392317019s) [noise=true , address=81.171.14.70:4028 , piece_id=INCSZCH2ZA23DSDXGXBHICU4YMNGTCDNFISNI2SNADPEKOE4I2RQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: read tcp 159.223.143.39:42198->81.171.14.70:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.624764414 (243h30m40.39244785s) [noise=true , address=81.171.14.70:4042 , piece_id=7YOGQYMBBQF3R2AALKZXLJUL5VJII5WMFLUKEUAYTLMLGTIJGDIQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: rpc: dial tcp 81.171.14.70:4042: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.624817700 (243h30m40.392501134s) [noise=true , address=81.171.14.70:4043 , piece_id=FQ5SR76KXNGIBI2T7AK3XFLN57YO4H5RBAAESPICBOL2L2FCWHBQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:41532->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625114736 (243h30m40.392798172s) [noise=true , address=81.171.14.70:4045 , piece_id=JC5POJW2ZGLZB6OFTPLS3PK3LAK6AE6SICLVYYP74RY3Z4KQE7IA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: read tcp 159.223.143.39:49638->81.171.14.70:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625409951 (243h30m40.393093382s) [noise=true , address=81.171.14.70:4047 , piece_id=VQN2T44TCUUMBDS23NHRBM2RO5F6TC4WGNQPL4DDRU3A6DQTMBEA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:40864->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625456822 (243h30m40.393140242s) [seg_pos={0 0}, upload=253234]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 21 13:17:15.727844444 (243h30m40.495527869s) [upload=253234]: Done uploading segments... Nov 21 13:17:15.727891684 (243h30m40.495575113s) [upload=253234]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 2.08666587s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 12.284431459s trace: https://jaeger.dev.storj.io/trace/3e276090513c6d3b FAIL (2025-11-21 13:22:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== 5L3BR7D5JBTEHIGBPAID5EJKUBYNETWMJWHJ5A, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.987498478 (243h29m40.755181917s) [noise=true , address=185.167.204.205:4031 , piece_id=IAZRVIE3YHQTNM22UYM4B7TCBYDA2EUMSNIK7C4R3637NTYHSLRQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.988154860 (243h29m40.755838308s) [noise=true , address=89.149.201.147:4009 , piece_id=BOG3EIF5CLQOJ4QOFVVOIYUVQH3YZBJJ5WKJ6BSE5WOF3NQMK5YA, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.988761968 (243h29m40.756445412s) [noise=true , address=185.167.204.206:4055 , piece_id=T2UM73BIH3KOT5XBVY3ZRQNQ672CPH57OKVVSVHVSFZU2D6PPTXQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.989455702 (243h29m40.757139137s) [noise=true , address=89.149.201.147:4021 , piece_id=ZHXGNV4M2G47UN3H6B2KLND3GBEHFIJ4ZDANVUBRX3SUQGTEFR2A, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.990168101 (243h29m40.757851537s) [noise=true , address=89.149.201.147:4018 , piece_id=2SATC6VJT4HHRCIUJWPSRPQGINCCSXTHVRIOKLHH7GAJ42NNAERA, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.990870219 (243h29m40.758553659s) [noise=true , address=185.167.204.206:4047 , piece_id=RIJHJETENKHV23KNYXZ5SSDOR5VLTSQ64IBSFSIKVCYB4SP35IOQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.991676123 (243h29m40.759359559s) [noise=true , address=81.171.14.70:4043 , piece_id=FQ5SR76KXNGIBI2T7AK3XFLN57YO4H5RBAAESPICBOL2L2FCWHBQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.993530722 (243h29m40.761214161s) [noise=true , address=185.167.204.205:4022 , piece_id=35QCU5FIDBUJQFNCJCHKWDDKGPPDXEDBKCNI5A5VMAS7NXZTTNGQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.995576845 (243h29m40.76326028s) [noise=true , address=81.171.14.70:4028 , piece_id=INCSZCH2ZA23DSDXGXBHICU4YMNGTCDNFISNI2SNADPEKOE4I2RQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:16.417071691 (243h29m41.184755117s) [upload=253234]: Next returned nil segment Nov 21 13:16:16.417088568 (243h29m41.184771994s) [upload=253234]: Waiting for error group managing segments... Nov 21 13:16:16.604253953 (243h29m41.37193741s) [noise=true , address=89.149.201.147:4009 , piece_id=BOG3EIF5CLQOJ4QOFVVOIYUVQH3YZBJJ5WKJ6BSE5WOF3NQMK5YA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.616631034 (243h29m41.384314459s) [noise=true , address=89.149.201.147:4022 , piece_id=S4CD6TBJIQGENSR3OUDZSFNUGEKCKG2KF6GS4DN3YAYF3FCK6BRQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.622248975 (243h29m41.389932404s) [noise=true , address=89.149.201.147:4021 , piece_id=ZHXGNV4M2G47UN3H6B2KLND3GBEHFIJ4ZDANVUBRX3SUQGTEFR2A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.622772397 (243h29m41.390455832s) [noise=true , address=89.149.201.147:4005 , piece_id=JVTLH6W7GNBKF6FI5K56GUKQ7LPWGSNZWV2X3TGFOHUKG2COXJDQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.635671178 (243h29m41.403354603s) [noise=true , address=185.167.204.206:4044 , piece_id=TJO4FHXPZWWLIISBTWLX2H4PDWFDGID2LWQAR7TAJGXM3OO6O73Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.638523014 (243h29m41.406206439s) [noise=true , address=185.167.204.206:4045 , piece_id=W26WUTNYVGHDZ6AA5BPGBRLTCXTS4DVWHYSW7ORP44BBJY7HVD2A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.647706039 (243h29m41.415389468s) [noise=true , address=185.167.204.205:4024 , piece_id=UQU4IGX45QTKY5SY5HEKRVCXDHK6PPYDZDTTKEHUDW6JETPQDUNA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.647997350 (243h29m41.415680775s) [noise=true , address=185.167.204.206:4058 , piece_id=75RVJDMPKHI56JQZBD7Y6NZYEWZCWILQM6IXOLHXFBX3ASOPAZCQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.650444384 (243h29m41.418127809s) [noise=true , address=185.167.204.205:4031 , piece_id=IAZRVIE3YHQTNM22UYM4B7TCBYDA2EUMSNIK7C4R3637NTYHSLRQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.651259970 (243h29m41.418943401s) [noise=true , address=185.167.204.206:4067 , piece_id=DYKO7IR5VSJGEYCEM672JGIDQGB4CIURDQ65FFZTC2TJCJCR4A7Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.653940496 (243h29m41.421623925s) [noise=true , address=185.167.204.205:4028 , piece_id=NUAIVIFVS3PIDLDP4I56II7GROUQ4N5HIGUUJLWEKDJM2HISQK7A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.656238559 (243h29m41.423921984s) [noise=true , address=185.167.204.205:4020 , piece_id=PVVA4UFQEOJNEJ2QXAIFREZEBJBSMOLCB7VVGOH5HR2NK4KELPYA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.658552874 (243h29m41.426236299s) [noise=true , address=185.167.204.206:4047 , piece_id=RIJHJETENKHV23KNYXZ5SSDOR5VLTSQ64IBSFSIKVCYB4SP35IOQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.658795439 (243h29m41.426478865s) [noise=true , address=185.167.204.206:4066 , piece_id=IJX27IPYXELRKHIBF3DLKORJ2IX55LRNAGPOUQEUZ3MPBN7FQCSQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.664043937 (243h29m41.431727378s) [noise=true , address=89.149.201.147:4001 , piece_id=6UMZWXB3BYCP6OZJOFREAYMD66PSUVZSNBBDRRYLWZSDDBAIHHYA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.664924438 (243h29m41.432607866s) [noise=true , address=185.167.204.206:4057 , piece_id=UZUKNSI26BGMZUWQULLZMIN7ZZNGVCYRLLFMNWT7KNLOD5GG65SQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.672162093 (243h29m41.439845519s) [noise=true , address=185.167.204.205:4022 , piece_id=35QCU5FIDBUJQFNCJCHKWDDKGPPDXEDBKCNI5A5VMAS7NXZTTNGQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.675169434 (243h29m41.44285286s) [noise=true , address=185.167.204.206:4063 , piece_id=LZ2MWIOS4OFWTV5L3BR7D5JBTEHIGBPAID5EJKUBYNETWMJWHJ5A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.676639209 (243h29m41.444322635s) [noise=true , address=185.167.204.206:4055 , piece_id=T2UM73BIH3KOT5XBVY3ZRQNQ672CPH57OKVVSVHVSFZU2D6PPTXQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.677425453 (243h29m41.445108879s) [noise=true , address=89.149.201.147:4018 , piece_id=2SATC6VJT4HHRCIUJWPSRPQGINCCSXTHVRIOKLHH7GAJ42NNAERA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:11.897994899 (243h30m36.665678325s) [noise=true , address=81.171.14.70:4025 , piece_id=TAKEHN75NX6RFEFRR5532A6AQJRBCS4REDGNAXJNWQMFWS6EQSWQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:13.995171303 (243h30m38.762854732s) [noise=true , address=81.171.14.70:4036 , piece_id=4KINF6GWQFNK7SEJBXVXTMKMFHWVZ4RRBMBONJEV74AHOYINAI3Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:14.620057026 (243h30m39.38774045s) [noise=true , address=81.171.14.70:4029 , piece_id=2ECO7GGZMVJPC5R6ADCLHXR7BHG5GAJJ5IQ7AIZQ4ND2YL6KR2SA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:15.624633590 (243h30m40.392317019s) [noise=true , address=81.171.14.70:4028 , piece_id=INCSZCH2ZA23DSDXGXBHICU4YMNGTCDNFISNI2SNADPEKOE4I2RQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: read tcp 159.223.143.39:42198->81.171.14.70:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.624764414 (243h30m40.39244785s) [noise=true , address=81.171.14.70:4042 , piece_id=7YOGQYMBBQF3R2AALKZXLJUL5VJII5WMFLUKEUAYTLMLGTIJGDIQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: rpc: dial tcp 81.171.14.70:4042: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.624817700 (243h30m40.392501134s) [noise=true , address=81.171.14.70:4043 , piece_id=FQ5SR76KXNGIBI2T7AK3XFLN57YO4H5RBAAESPICBOL2L2FCWHBQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:41532->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625114736 (243h30m40.392798172s) [noise=true , address=81.171.14.70:4045 , piece_id=JC5POJW2ZGLZB6OFTPLS3PK3LAK6AE6SICLVYYP74RY3Z4KQE7IA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: read tcp 159.223.143.39:49638->81.171.14.70:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625409951 (243h30m40.393093382s) [noise=true , address=81.171.14.70:4047 , piece_id=VQN2T44TCUUMBDS23NHRBM2RO5F6TC4WGNQPL4DDRU3A6DQTMBEA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:40864->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625456822 (243h30m40.393140242s) [seg_pos={0 0}, upload=253234]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 21 13:17:15.727844444 (243h30m40.495527869s) [upload=253234]: Done uploading segments... Nov 21 13:17:15.727891684 (243h30m40.495575113s) [upload=253234]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 12.284474153s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.150740308s trace: https://jaeger.dev.storj.io/trace/3e276090513c6d3b FAIL (2025-11-21 13:21:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== 5L3BR7D5JBTEHIGBPAID5EJKUBYNETWMJWHJ5A, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.987498478 (243h29m40.755181917s) [noise=true , address=185.167.204.205:4031 , piece_id=IAZRVIE3YHQTNM22UYM4B7TCBYDA2EUMSNIK7C4R3637NTYHSLRQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.988154860 (243h29m40.755838308s) [noise=true , address=89.149.201.147:4009 , piece_id=BOG3EIF5CLQOJ4QOFVVOIYUVQH3YZBJJ5WKJ6BSE5WOF3NQMK5YA, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.988761968 (243h29m40.756445412s) [noise=true , address=185.167.204.206:4055 , piece_id=T2UM73BIH3KOT5XBVY3ZRQNQ672CPH57OKVVSVHVSFZU2D6PPTXQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.989455702 (243h29m40.757139137s) [noise=true , address=89.149.201.147:4021 , piece_id=ZHXGNV4M2G47UN3H6B2KLND3GBEHFIJ4ZDANVUBRX3SUQGTEFR2A, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.990168101 (243h29m40.757851537s) [noise=true , address=89.149.201.147:4018 , piece_id=2SATC6VJT4HHRCIUJWPSRPQGINCCSXTHVRIOKLHH7GAJ42NNAERA, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.990870219 (243h29m40.758553659s) [noise=true , address=185.167.204.206:4047 , piece_id=RIJHJETENKHV23KNYXZ5SSDOR5VLTSQ64IBSFSIKVCYB4SP35IOQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.991676123 (243h29m40.759359559s) [noise=true , address=81.171.14.70:4043 , piece_id=FQ5SR76KXNGIBI2T7AK3XFLN57YO4H5RBAAESPICBOL2L2FCWHBQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.993530722 (243h29m40.761214161s) [noise=true , address=185.167.204.205:4022 , piece_id=35QCU5FIDBUJQFNCJCHKWDDKGPPDXEDBKCNI5A5VMAS7NXZTTNGQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.995576845 (243h29m40.76326028s) [noise=true , address=81.171.14.70:4028 , piece_id=INCSZCH2ZA23DSDXGXBHICU4YMNGTCDNFISNI2SNADPEKOE4I2RQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:16.417071691 (243h29m41.184755117s) [upload=253234]: Next returned nil segment Nov 21 13:16:16.417088568 (243h29m41.184771994s) [upload=253234]: Waiting for error group managing segments... Nov 21 13:16:16.604253953 (243h29m41.37193741s) [noise=true , address=89.149.201.147:4009 , piece_id=BOG3EIF5CLQOJ4QOFVVOIYUVQH3YZBJJ5WKJ6BSE5WOF3NQMK5YA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.616631034 (243h29m41.384314459s) [noise=true , address=89.149.201.147:4022 , piece_id=S4CD6TBJIQGENSR3OUDZSFNUGEKCKG2KF6GS4DN3YAYF3FCK6BRQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.622248975 (243h29m41.389932404s) [noise=true , address=89.149.201.147:4021 , piece_id=ZHXGNV4M2G47UN3H6B2KLND3GBEHFIJ4ZDANVUBRX3SUQGTEFR2A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.622772397 (243h29m41.390455832s) [noise=true , address=89.149.201.147:4005 , piece_id=JVTLH6W7GNBKF6FI5K56GUKQ7LPWGSNZWV2X3TGFOHUKG2COXJDQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.635671178 (243h29m41.403354603s) [noise=true , address=185.167.204.206:4044 , piece_id=TJO4FHXPZWWLIISBTWLX2H4PDWFDGID2LWQAR7TAJGXM3OO6O73Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.638523014 (243h29m41.406206439s) [noise=true , address=185.167.204.206:4045 , piece_id=W26WUTNYVGHDZ6AA5BPGBRLTCXTS4DVWHYSW7ORP44BBJY7HVD2A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.647706039 (243h29m41.415389468s) [noise=true , address=185.167.204.205:4024 , piece_id=UQU4IGX45QTKY5SY5HEKRVCXDHK6PPYDZDTTKEHUDW6JETPQDUNA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.647997350 (243h29m41.415680775s) [noise=true , address=185.167.204.206:4058 , piece_id=75RVJDMPKHI56JQZBD7Y6NZYEWZCWILQM6IXOLHXFBX3ASOPAZCQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.650444384 (243h29m41.418127809s) [noise=true , address=185.167.204.205:4031 , piece_id=IAZRVIE3YHQTNM22UYM4B7TCBYDA2EUMSNIK7C4R3637NTYHSLRQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.651259970 (243h29m41.418943401s) [noise=true , address=185.167.204.206:4067 , piece_id=DYKO7IR5VSJGEYCEM672JGIDQGB4CIURDQ65FFZTC2TJCJCR4A7Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.653940496 (243h29m41.421623925s) [noise=true , address=185.167.204.205:4028 , piece_id=NUAIVIFVS3PIDLDP4I56II7GROUQ4N5HIGUUJLWEKDJM2HISQK7A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.656238559 (243h29m41.423921984s) [noise=true , address=185.167.204.205:4020 , piece_id=PVVA4UFQEOJNEJ2QXAIFREZEBJBSMOLCB7VVGOH5HR2NK4KELPYA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.658552874 (243h29m41.426236299s) [noise=true , address=185.167.204.206:4047 , piece_id=RIJHJETENKHV23KNYXZ5SSDOR5VLTSQ64IBSFSIKVCYB4SP35IOQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.658795439 (243h29m41.426478865s) [noise=true , address=185.167.204.206:4066 , piece_id=IJX27IPYXELRKHIBF3DLKORJ2IX55LRNAGPOUQEUZ3MPBN7FQCSQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.664043937 (243h29m41.431727378s) [noise=true , address=89.149.201.147:4001 , piece_id=6UMZWXB3BYCP6OZJOFREAYMD66PSUVZSNBBDRRYLWZSDDBAIHHYA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.664924438 (243h29m41.432607866s) [noise=true , address=185.167.204.206:4057 , piece_id=UZUKNSI26BGMZUWQULLZMIN7ZZNGVCYRLLFMNWT7KNLOD5GG65SQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.672162093 (243h29m41.439845519s) [noise=true , address=185.167.204.205:4022 , piece_id=35QCU5FIDBUJQFNCJCHKWDDKGPPDXEDBKCNI5A5VMAS7NXZTTNGQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.675169434 (243h29m41.44285286s) [noise=true , address=185.167.204.206:4063 , piece_id=LZ2MWIOS4OFWTV5L3BR7D5JBTEHIGBPAID5EJKUBYNETWMJWHJ5A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.676639209 (243h29m41.444322635s) [noise=true , address=185.167.204.206:4055 , piece_id=T2UM73BIH3KOT5XBVY3ZRQNQ672CPH57OKVVSVHVSFZU2D6PPTXQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.677425453 (243h29m41.445108879s) [noise=true , address=89.149.201.147:4018 , piece_id=2SATC6VJT4HHRCIUJWPSRPQGINCCSXTHVRIOKLHH7GAJ42NNAERA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:11.897994899 (243h30m36.665678325s) [noise=true , address=81.171.14.70:4025 , piece_id=TAKEHN75NX6RFEFRR5532A6AQJRBCS4REDGNAXJNWQMFWS6EQSWQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:13.995171303 (243h30m38.762854732s) [noise=true , address=81.171.14.70:4036 , piece_id=4KINF6GWQFNK7SEJBXVXTMKMFHWVZ4RRBMBONJEV74AHOYINAI3Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:14.620057026 (243h30m39.38774045s) [noise=true , address=81.171.14.70:4029 , piece_id=2ECO7GGZMVJPC5R6ADCLHXR7BHG5GAJJ5IQ7AIZQ4ND2YL6KR2SA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:15.624633590 (243h30m40.392317019s) [noise=true , address=81.171.14.70:4028 , piece_id=INCSZCH2ZA23DSDXGXBHICU4YMNGTCDNFISNI2SNADPEKOE4I2RQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: read tcp 159.223.143.39:42198->81.171.14.70:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.624764414 (243h30m40.39244785s) [noise=true , address=81.171.14.70:4042 , piece_id=7YOGQYMBBQF3R2AALKZXLJUL5VJII5WMFLUKEUAYTLMLGTIJGDIQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: rpc: dial tcp 81.171.14.70:4042: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.624817700 (243h30m40.392501134s) [noise=true , address=81.171.14.70:4043 , piece_id=FQ5SR76KXNGIBI2T7AK3XFLN57YO4H5RBAAESPICBOL2L2FCWHBQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:41532->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625114736 (243h30m40.392798172s) [noise=true , address=81.171.14.70:4045 , piece_id=JC5POJW2ZGLZB6OFTPLS3PK3LAK6AE6SICLVYYP74RY3Z4KQE7IA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: read tcp 159.223.143.39:49638->81.171.14.70:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625409951 (243h30m40.393093382s) [noise=true , address=81.171.14.70:4047 , piece_id=VQN2T44TCUUMBDS23NHRBM2RO5F6TC4WGNQPL4DDRU3A6DQTMBEA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:40864->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625456822 (243h30m40.393140242s) [seg_pos={0 0}, upload=253234]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 21 13:17:15.727844444 (243h30m40.495527869s) [upload=253234]: Done uploading segments... Nov 21 13:17:15.727891684 (243h30m40.495575113s) [upload=253234]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 2.150885902s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.094592516s trace: https://jaeger.dev.storj.io/trace/3e276090513c6d3b FAIL (2025-11-21 13:21:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== 5L3BR7D5JBTEHIGBPAID5EJKUBYNETWMJWHJ5A, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.987498478 (243h29m40.755181917s) [noise=true , address=185.167.204.205:4031 , piece_id=IAZRVIE3YHQTNM22UYM4B7TCBYDA2EUMSNIK7C4R3637NTYHSLRQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.988154860 (243h29m40.755838308s) [noise=true , address=89.149.201.147:4009 , piece_id=BOG3EIF5CLQOJ4QOFVVOIYUVQH3YZBJJ5WKJ6BSE5WOF3NQMK5YA, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.988761968 (243h29m40.756445412s) [noise=true , address=185.167.204.206:4055 , piece_id=T2UM73BIH3KOT5XBVY3ZRQNQ672CPH57OKVVSVHVSFZU2D6PPTXQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.989455702 (243h29m40.757139137s) [noise=true , address=89.149.201.147:4021 , piece_id=ZHXGNV4M2G47UN3H6B2KLND3GBEHFIJ4ZDANVUBRX3SUQGTEFR2A, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.990168101 (243h29m40.757851537s) [noise=true , address=89.149.201.147:4018 , piece_id=2SATC6VJT4HHRCIUJWPSRPQGINCCSXTHVRIOKLHH7GAJ42NNAERA, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.990870219 (243h29m40.758553659s) [noise=true , address=185.167.204.206:4047 , piece_id=RIJHJETENKHV23KNYXZ5SSDOR5VLTSQ64IBSFSIKVCYB4SP35IOQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.991676123 (243h29m40.759359559s) [noise=true , address=81.171.14.70:4043 , piece_id=FQ5SR76KXNGIBI2T7AK3XFLN57YO4H5RBAAESPICBOL2L2FCWHBQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.993530722 (243h29m40.761214161s) [noise=true , address=185.167.204.205:4022 , piece_id=35QCU5FIDBUJQFNCJCHKWDDKGPPDXEDBKCNI5A5VMAS7NXZTTNGQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.995576845 (243h29m40.76326028s) [noise=true , address=81.171.14.70:4028 , piece_id=INCSZCH2ZA23DSDXGXBHICU4YMNGTCDNFISNI2SNADPEKOE4I2RQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:16.417071691 (243h29m41.184755117s) [upload=253234]: Next returned nil segment Nov 21 13:16:16.417088568 (243h29m41.184771994s) [upload=253234]: Waiting for error group managing segments... Nov 21 13:16:16.604253953 (243h29m41.37193741s) [noise=true , address=89.149.201.147:4009 , piece_id=BOG3EIF5CLQOJ4QOFVVOIYUVQH3YZBJJ5WKJ6BSE5WOF3NQMK5YA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.616631034 (243h29m41.384314459s) [noise=true , address=89.149.201.147:4022 , piece_id=S4CD6TBJIQGENSR3OUDZSFNUGEKCKG2KF6GS4DN3YAYF3FCK6BRQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.622248975 (243h29m41.389932404s) [noise=true , address=89.149.201.147:4021 , piece_id=ZHXGNV4M2G47UN3H6B2KLND3GBEHFIJ4ZDANVUBRX3SUQGTEFR2A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.622772397 (243h29m41.390455832s) [noise=true , address=89.149.201.147:4005 , piece_id=JVTLH6W7GNBKF6FI5K56GUKQ7LPWGSNZWV2X3TGFOHUKG2COXJDQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.635671178 (243h29m41.403354603s) [noise=true , address=185.167.204.206:4044 , piece_id=TJO4FHXPZWWLIISBTWLX2H4PDWFDGID2LWQAR7TAJGXM3OO6O73Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.638523014 (243h29m41.406206439s) [noise=true , address=185.167.204.206:4045 , piece_id=W26WUTNYVGHDZ6AA5BPGBRLTCXTS4DVWHYSW7ORP44BBJY7HVD2A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.647706039 (243h29m41.415389468s) [noise=true , address=185.167.204.205:4024 , piece_id=UQU4IGX45QTKY5SY5HEKRVCXDHK6PPYDZDTTKEHUDW6JETPQDUNA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.647997350 (243h29m41.415680775s) [noise=true , address=185.167.204.206:4058 , piece_id=75RVJDMPKHI56JQZBD7Y6NZYEWZCWILQM6IXOLHXFBX3ASOPAZCQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.650444384 (243h29m41.418127809s) [noise=true , address=185.167.204.205:4031 , piece_id=IAZRVIE3YHQTNM22UYM4B7TCBYDA2EUMSNIK7C4R3637NTYHSLRQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.651259970 (243h29m41.418943401s) [noise=true , address=185.167.204.206:4067 , piece_id=DYKO7IR5VSJGEYCEM672JGIDQGB4CIURDQ65FFZTC2TJCJCR4A7Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.653940496 (243h29m41.421623925s) [noise=true , address=185.167.204.205:4028 , piece_id=NUAIVIFVS3PIDLDP4I56II7GROUQ4N5HIGUUJLWEKDJM2HISQK7A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.656238559 (243h29m41.423921984s) [noise=true , address=185.167.204.205:4020 , piece_id=PVVA4UFQEOJNEJ2QXAIFREZEBJBSMOLCB7VVGOH5HR2NK4KELPYA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.658552874 (243h29m41.426236299s) [noise=true , address=185.167.204.206:4047 , piece_id=RIJHJETENKHV23KNYXZ5SSDOR5VLTSQ64IBSFSIKVCYB4SP35IOQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.658795439 (243h29m41.426478865s) [noise=true , address=185.167.204.206:4066 , piece_id=IJX27IPYXELRKHIBF3DLKORJ2IX55LRNAGPOUQEUZ3MPBN7FQCSQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.664043937 (243h29m41.431727378s) [noise=true , address=89.149.201.147:4001 , piece_id=6UMZWXB3BYCP6OZJOFREAYMD66PSUVZSNBBDRRYLWZSDDBAIHHYA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.664924438 (243h29m41.432607866s) [noise=true , address=185.167.204.206:4057 , piece_id=UZUKNSI26BGMZUWQULLZMIN7ZZNGVCYRLLFMNWT7KNLOD5GG65SQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.672162093 (243h29m41.439845519s) [noise=true , address=185.167.204.205:4022 , piece_id=35QCU5FIDBUJQFNCJCHKWDDKGPPDXEDBKCNI5A5VMAS7NXZTTNGQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.675169434 (243h29m41.44285286s) [noise=true , address=185.167.204.206:4063 , piece_id=LZ2MWIOS4OFWTV5L3BR7D5JBTEHIGBPAID5EJKUBYNETWMJWHJ5A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.676639209 (243h29m41.444322635s) [noise=true , address=185.167.204.206:4055 , piece_id=T2UM73BIH3KOT5XBVY3ZRQNQ672CPH57OKVVSVHVSFZU2D6PPTXQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.677425453 (243h29m41.445108879s) [noise=true , address=89.149.201.147:4018 , piece_id=2SATC6VJT4HHRCIUJWPSRPQGINCCSXTHVRIOKLHH7GAJ42NNAERA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:11.897994899 (243h30m36.665678325s) [noise=true , address=81.171.14.70:4025 , piece_id=TAKEHN75NX6RFEFRR5532A6AQJRBCS4REDGNAXJNWQMFWS6EQSWQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:13.995171303 (243h30m38.762854732s) [noise=true , address=81.171.14.70:4036 , piece_id=4KINF6GWQFNK7SEJBXVXTMKMFHWVZ4RRBMBONJEV74AHOYINAI3Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:14.620057026 (243h30m39.38774045s) [noise=true , address=81.171.14.70:4029 , piece_id=2ECO7GGZMVJPC5R6ADCLHXR7BHG5GAJJ5IQ7AIZQ4ND2YL6KR2SA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:15.624633590 (243h30m40.392317019s) [noise=true , address=81.171.14.70:4028 , piece_id=INCSZCH2ZA23DSDXGXBHICU4YMNGTCDNFISNI2SNADPEKOE4I2RQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: read tcp 159.223.143.39:42198->81.171.14.70:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.624764414 (243h30m40.39244785s) [noise=true , address=81.171.14.70:4042 , piece_id=7YOGQYMBBQF3R2AALKZXLJUL5VJII5WMFLUKEUAYTLMLGTIJGDIQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: rpc: dial tcp 81.171.14.70:4042: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.624817700 (243h30m40.392501134s) [noise=true , address=81.171.14.70:4043 , piece_id=FQ5SR76KXNGIBI2T7AK3XFLN57YO4H5RBAAESPICBOL2L2FCWHBQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:41532->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625114736 (243h30m40.392798172s) [noise=true , address=81.171.14.70:4045 , piece_id=JC5POJW2ZGLZB6OFTPLS3PK3LAK6AE6SICLVYYP74RY3Z4KQE7IA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: read tcp 159.223.143.39:49638->81.171.14.70:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625409951 (243h30m40.393093382s) [noise=true , address=81.171.14.70:4047 , piece_id=VQN2T44TCUUMBDS23NHRBM2RO5F6TC4WGNQPL4DDRU3A6DQTMBEA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:40864->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625456822 (243h30m40.393140242s) [seg_pos={0 0}, upload=253234]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 21 13:17:15.727844444 (243h30m40.495527869s) [upload=253234]: Done uploading segments... Nov 21 13:17:15.727891684 (243h30m40.495575113s) [upload=253234]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 2.094621608s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.972897829s trace: https://jaeger.dev.storj.io/trace/3e276090513c6d3b FAIL (2025-11-21 13:20:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== 5L3BR7D5JBTEHIGBPAID5EJKUBYNETWMJWHJ5A, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.987498478 (243h29m40.755181917s) [noise=true , address=185.167.204.205:4031 , piece_id=IAZRVIE3YHQTNM22UYM4B7TCBYDA2EUMSNIK7C4R3637NTYHSLRQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.988154860 (243h29m40.755838308s) [noise=true , address=89.149.201.147:4009 , piece_id=BOG3EIF5CLQOJ4QOFVVOIYUVQH3YZBJJ5WKJ6BSE5WOF3NQMK5YA, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.988761968 (243h29m40.756445412s) [noise=true , address=185.167.204.206:4055 , piece_id=T2UM73BIH3KOT5XBVY3ZRQNQ672CPH57OKVVSVHVSFZU2D6PPTXQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.989455702 (243h29m40.757139137s) [noise=true , address=89.149.201.147:4021 , piece_id=ZHXGNV4M2G47UN3H6B2KLND3GBEHFIJ4ZDANVUBRX3SUQGTEFR2A, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.990168101 (243h29m40.757851537s) [noise=true , address=89.149.201.147:4018 , piece_id=2SATC6VJT4HHRCIUJWPSRPQGINCCSXTHVRIOKLHH7GAJ42NNAERA, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.990870219 (243h29m40.758553659s) [noise=true , address=185.167.204.206:4047 , piece_id=RIJHJETENKHV23KNYXZ5SSDOR5VLTSQ64IBSFSIKVCYB4SP35IOQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.991676123 (243h29m40.759359559s) [noise=true , address=81.171.14.70:4043 , piece_id=FQ5SR76KXNGIBI2T7AK3XFLN57YO4H5RBAAESPICBOL2L2FCWHBQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.993530722 (243h29m40.761214161s) [noise=true , address=185.167.204.205:4022 , piece_id=35QCU5FIDBUJQFNCJCHKWDDKGPPDXEDBKCNI5A5VMAS7NXZTTNGQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.995576845 (243h29m40.76326028s) [noise=true , address=81.171.14.70:4028 , piece_id=INCSZCH2ZA23DSDXGXBHICU4YMNGTCDNFISNI2SNADPEKOE4I2RQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:16.417071691 (243h29m41.184755117s) [upload=253234]: Next returned nil segment Nov 21 13:16:16.417088568 (243h29m41.184771994s) [upload=253234]: Waiting for error group managing segments... Nov 21 13:16:16.604253953 (243h29m41.37193741s) [noise=true , address=89.149.201.147:4009 , piece_id=BOG3EIF5CLQOJ4QOFVVOIYUVQH3YZBJJ5WKJ6BSE5WOF3NQMK5YA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.616631034 (243h29m41.384314459s) [noise=true , address=89.149.201.147:4022 , piece_id=S4CD6TBJIQGENSR3OUDZSFNUGEKCKG2KF6GS4DN3YAYF3FCK6BRQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.622248975 (243h29m41.389932404s) [noise=true , address=89.149.201.147:4021 , piece_id=ZHXGNV4M2G47UN3H6B2KLND3GBEHFIJ4ZDANVUBRX3SUQGTEFR2A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.622772397 (243h29m41.390455832s) [noise=true , address=89.149.201.147:4005 , piece_id=JVTLH6W7GNBKF6FI5K56GUKQ7LPWGSNZWV2X3TGFOHUKG2COXJDQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.635671178 (243h29m41.403354603s) [noise=true , address=185.167.204.206:4044 , piece_id=TJO4FHXPZWWLIISBTWLX2H4PDWFDGID2LWQAR7TAJGXM3OO6O73Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.638523014 (243h29m41.406206439s) [noise=true , address=185.167.204.206:4045 , piece_id=W26WUTNYVGHDZ6AA5BPGBRLTCXTS4DVWHYSW7ORP44BBJY7HVD2A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.647706039 (243h29m41.415389468s) [noise=true , address=185.167.204.205:4024 , piece_id=UQU4IGX45QTKY5SY5HEKRVCXDHK6PPYDZDTTKEHUDW6JETPQDUNA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.647997350 (243h29m41.415680775s) [noise=true , address=185.167.204.206:4058 , piece_id=75RVJDMPKHI56JQZBD7Y6NZYEWZCWILQM6IXOLHXFBX3ASOPAZCQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.650444384 (243h29m41.418127809s) [noise=true , address=185.167.204.205:4031 , piece_id=IAZRVIE3YHQTNM22UYM4B7TCBYDA2EUMSNIK7C4R3637NTYHSLRQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.651259970 (243h29m41.418943401s) [noise=true , address=185.167.204.206:4067 , piece_id=DYKO7IR5VSJGEYCEM672JGIDQGB4CIURDQ65FFZTC2TJCJCR4A7Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.653940496 (243h29m41.421623925s) [noise=true , address=185.167.204.205:4028 , piece_id=NUAIVIFVS3PIDLDP4I56II7GROUQ4N5HIGUUJLWEKDJM2HISQK7A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.656238559 (243h29m41.423921984s) [noise=true , address=185.167.204.205:4020 , piece_id=PVVA4UFQEOJNEJ2QXAIFREZEBJBSMOLCB7VVGOH5HR2NK4KELPYA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.658552874 (243h29m41.426236299s) [noise=true , address=185.167.204.206:4047 , piece_id=RIJHJETENKHV23KNYXZ5SSDOR5VLTSQ64IBSFSIKVCYB4SP35IOQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.658795439 (243h29m41.426478865s) [noise=true , address=185.167.204.206:4066 , piece_id=IJX27IPYXELRKHIBF3DLKORJ2IX55LRNAGPOUQEUZ3MPBN7FQCSQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.664043937 (243h29m41.431727378s) [noise=true , address=89.149.201.147:4001 , piece_id=6UMZWXB3BYCP6OZJOFREAYMD66PSUVZSNBBDRRYLWZSDDBAIHHYA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.664924438 (243h29m41.432607866s) [noise=true , address=185.167.204.206:4057 , piece_id=UZUKNSI26BGMZUWQULLZMIN7ZZNGVCYRLLFMNWT7KNLOD5GG65SQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.672162093 (243h29m41.439845519s) [noise=true , address=185.167.204.205:4022 , piece_id=35QCU5FIDBUJQFNCJCHKWDDKGPPDXEDBKCNI5A5VMAS7NXZTTNGQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.675169434 (243h29m41.44285286s) [noise=true , address=185.167.204.206:4063 , piece_id=LZ2MWIOS4OFWTV5L3BR7D5JBTEHIGBPAID5EJKUBYNETWMJWHJ5A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.676639209 (243h29m41.444322635s) [noise=true , address=185.167.204.206:4055 , piece_id=T2UM73BIH3KOT5XBVY3ZRQNQ672CPH57OKVVSVHVSFZU2D6PPTXQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.677425453 (243h29m41.445108879s) [noise=true , address=89.149.201.147:4018 , piece_id=2SATC6VJT4HHRCIUJWPSRPQGINCCSXTHVRIOKLHH7GAJ42NNAERA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:11.897994899 (243h30m36.665678325s) [noise=true , address=81.171.14.70:4025 , piece_id=TAKEHN75NX6RFEFRR5532A6AQJRBCS4REDGNAXJNWQMFWS6EQSWQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:13.995171303 (243h30m38.762854732s) [noise=true , address=81.171.14.70:4036 , piece_id=4KINF6GWQFNK7SEJBXVXTMKMFHWVZ4RRBMBONJEV74AHOYINAI3Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:14.620057026 (243h30m39.38774045s) [noise=true , address=81.171.14.70:4029 , piece_id=2ECO7GGZMVJPC5R6ADCLHXR7BHG5GAJJ5IQ7AIZQ4ND2YL6KR2SA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:15.624633590 (243h30m40.392317019s) [noise=true , address=81.171.14.70:4028 , piece_id=INCSZCH2ZA23DSDXGXBHICU4YMNGTCDNFISNI2SNADPEKOE4I2RQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: read tcp 159.223.143.39:42198->81.171.14.70:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.624764414 (243h30m40.39244785s) [noise=true , address=81.171.14.70:4042 , piece_id=7YOGQYMBBQF3R2AALKZXLJUL5VJII5WMFLUKEUAYTLMLGTIJGDIQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: rpc: dial tcp 81.171.14.70:4042: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.624817700 (243h30m40.392501134s) [noise=true , address=81.171.14.70:4043 , piece_id=FQ5SR76KXNGIBI2T7AK3XFLN57YO4H5RBAAESPICBOL2L2FCWHBQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:41532->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625114736 (243h30m40.392798172s) [noise=true , address=81.171.14.70:4045 , piece_id=JC5POJW2ZGLZB6OFTPLS3PK3LAK6AE6SICLVYYP74RY3Z4KQE7IA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: read tcp 159.223.143.39:49638->81.171.14.70:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625409951 (243h30m40.393093382s) [noise=true , address=81.171.14.70:4047 , piece_id=VQN2T44TCUUMBDS23NHRBM2RO5F6TC4WGNQPL4DDRU3A6DQTMBEA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:40864->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625456822 (243h30m40.393140242s) [seg_pos={0 0}, upload=253234]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 21 13:17:15.727844444 (243h30m40.495527869s) [upload=253234]: Done uploading segments... Nov 21 13:17:15.727891684 (243h30m40.495575113s) [upload=253234]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 2.972926652s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 2.125650353s trace: https://jaeger.dev.storj.io/trace/3e276090513c6d3b FAIL (2025-11-21 13:19:25 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== 5L3BR7D5JBTEHIGBPAID5EJKUBYNETWMJWHJ5A, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.987498478 (243h29m40.755181917s) [noise=true , address=185.167.204.205:4031 , piece_id=IAZRVIE3YHQTNM22UYM4B7TCBYDA2EUMSNIK7C4R3637NTYHSLRQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.988154860 (243h29m40.755838308s) [noise=true , address=89.149.201.147:4009 , piece_id=BOG3EIF5CLQOJ4QOFVVOIYUVQH3YZBJJ5WKJ6BSE5WOF3NQMK5YA, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.988761968 (243h29m40.756445412s) [noise=true , address=185.167.204.206:4055 , piece_id=T2UM73BIH3KOT5XBVY3ZRQNQ672CPH57OKVVSVHVSFZU2D6PPTXQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.989455702 (243h29m40.757139137s) [noise=true , address=89.149.201.147:4021 , piece_id=ZHXGNV4M2G47UN3H6B2KLND3GBEHFIJ4ZDANVUBRX3SUQGTEFR2A, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.990168101 (243h29m40.757851537s) [noise=true , address=89.149.201.147:4018 , piece_id=2SATC6VJT4HHRCIUJWPSRPQGINCCSXTHVRIOKLHH7GAJ42NNAERA, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.990870219 (243h29m40.758553659s) [noise=true , address=185.167.204.206:4047 , piece_id=RIJHJETENKHV23KNYXZ5SSDOR5VLTSQ64IBSFSIKVCYB4SP35IOQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.991676123 (243h29m40.759359559s) [noise=true , address=81.171.14.70:4043 , piece_id=FQ5SR76KXNGIBI2T7AK3XFLN57YO4H5RBAAESPICBOL2L2FCWHBQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.993530722 (243h29m40.761214161s) [noise=true , address=185.167.204.205:4022 , piece_id=35QCU5FIDBUJQFNCJCHKWDDKGPPDXEDBKCNI5A5VMAS7NXZTTNGQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.995576845 (243h29m40.76326028s) [noise=true , address=81.171.14.70:4028 , piece_id=INCSZCH2ZA23DSDXGXBHICU4YMNGTCDNFISNI2SNADPEKOE4I2RQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:16.417071691 (243h29m41.184755117s) [upload=253234]: Next returned nil segment Nov 21 13:16:16.417088568 (243h29m41.184771994s) [upload=253234]: Waiting for error group managing segments... Nov 21 13:16:16.604253953 (243h29m41.37193741s) [noise=true , address=89.149.201.147:4009 , piece_id=BOG3EIF5CLQOJ4QOFVVOIYUVQH3YZBJJ5WKJ6BSE5WOF3NQMK5YA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.616631034 (243h29m41.384314459s) [noise=true , address=89.149.201.147:4022 , piece_id=S4CD6TBJIQGENSR3OUDZSFNUGEKCKG2KF6GS4DN3YAYF3FCK6BRQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.622248975 (243h29m41.389932404s) [noise=true , address=89.149.201.147:4021 , piece_id=ZHXGNV4M2G47UN3H6B2KLND3GBEHFIJ4ZDANVUBRX3SUQGTEFR2A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.622772397 (243h29m41.390455832s) [noise=true , address=89.149.201.147:4005 , piece_id=JVTLH6W7GNBKF6FI5K56GUKQ7LPWGSNZWV2X3TGFOHUKG2COXJDQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.635671178 (243h29m41.403354603s) [noise=true , address=185.167.204.206:4044 , piece_id=TJO4FHXPZWWLIISBTWLX2H4PDWFDGID2LWQAR7TAJGXM3OO6O73Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.638523014 (243h29m41.406206439s) [noise=true , address=185.167.204.206:4045 , piece_id=W26WUTNYVGHDZ6AA5BPGBRLTCXTS4DVWHYSW7ORP44BBJY7HVD2A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.647706039 (243h29m41.415389468s) [noise=true , address=185.167.204.205:4024 , piece_id=UQU4IGX45QTKY5SY5HEKRVCXDHK6PPYDZDTTKEHUDW6JETPQDUNA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.647997350 (243h29m41.415680775s) [noise=true , address=185.167.204.206:4058 , piece_id=75RVJDMPKHI56JQZBD7Y6NZYEWZCWILQM6IXOLHXFBX3ASOPAZCQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.650444384 (243h29m41.418127809s) [noise=true , address=185.167.204.205:4031 , piece_id=IAZRVIE3YHQTNM22UYM4B7TCBYDA2EUMSNIK7C4R3637NTYHSLRQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.651259970 (243h29m41.418943401s) [noise=true , address=185.167.204.206:4067 , piece_id=DYKO7IR5VSJGEYCEM672JGIDQGB4CIURDQ65FFZTC2TJCJCR4A7Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.653940496 (243h29m41.421623925s) [noise=true , address=185.167.204.205:4028 , piece_id=NUAIVIFVS3PIDLDP4I56II7GROUQ4N5HIGUUJLWEKDJM2HISQK7A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.656238559 (243h29m41.423921984s) [noise=true , address=185.167.204.205:4020 , piece_id=PVVA4UFQEOJNEJ2QXAIFREZEBJBSMOLCB7VVGOH5HR2NK4KELPYA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.658552874 (243h29m41.426236299s) [noise=true , address=185.167.204.206:4047 , piece_id=RIJHJETENKHV23KNYXZ5SSDOR5VLTSQ64IBSFSIKVCYB4SP35IOQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.658795439 (243h29m41.426478865s) [noise=true , address=185.167.204.206:4066 , piece_id=IJX27IPYXELRKHIBF3DLKORJ2IX55LRNAGPOUQEUZ3MPBN7FQCSQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.664043937 (243h29m41.431727378s) [noise=true , address=89.149.201.147:4001 , piece_id=6UMZWXB3BYCP6OZJOFREAYMD66PSUVZSNBBDRRYLWZSDDBAIHHYA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.664924438 (243h29m41.432607866s) [noise=true , address=185.167.204.206:4057 , piece_id=UZUKNSI26BGMZUWQULLZMIN7ZZNGVCYRLLFMNWT7KNLOD5GG65SQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.672162093 (243h29m41.439845519s) [noise=true , address=185.167.204.205:4022 , piece_id=35QCU5FIDBUJQFNCJCHKWDDKGPPDXEDBKCNI5A5VMAS7NXZTTNGQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.675169434 (243h29m41.44285286s) [noise=true , address=185.167.204.206:4063 , piece_id=LZ2MWIOS4OFWTV5L3BR7D5JBTEHIGBPAID5EJKUBYNETWMJWHJ5A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.676639209 (243h29m41.444322635s) [noise=true , address=185.167.204.206:4055 , piece_id=T2UM73BIH3KOT5XBVY3ZRQNQ672CPH57OKVVSVHVSFZU2D6PPTXQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.677425453 (243h29m41.445108879s) [noise=true , address=89.149.201.147:4018 , piece_id=2SATC6VJT4HHRCIUJWPSRPQGINCCSXTHVRIOKLHH7GAJ42NNAERA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:11.897994899 (243h30m36.665678325s) [noise=true , address=81.171.14.70:4025 , piece_id=TAKEHN75NX6RFEFRR5532A6AQJRBCS4REDGNAXJNWQMFWS6EQSWQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:13.995171303 (243h30m38.762854732s) [noise=true , address=81.171.14.70:4036 , piece_id=4KINF6GWQFNK7SEJBXVXTMKMFHWVZ4RRBMBONJEV74AHOYINAI3Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:14.620057026 (243h30m39.38774045s) [noise=true , address=81.171.14.70:4029 , piece_id=2ECO7GGZMVJPC5R6ADCLHXR7BHG5GAJJ5IQ7AIZQ4ND2YL6KR2SA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:15.624633590 (243h30m40.392317019s) [noise=true , address=81.171.14.70:4028 , piece_id=INCSZCH2ZA23DSDXGXBHICU4YMNGTCDNFISNI2SNADPEKOE4I2RQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: read tcp 159.223.143.39:42198->81.171.14.70:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.624764414 (243h30m40.39244785s) [noise=true , address=81.171.14.70:4042 , piece_id=7YOGQYMBBQF3R2AALKZXLJUL5VJII5WMFLUKEUAYTLMLGTIJGDIQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: rpc: dial tcp 81.171.14.70:4042: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.624817700 (243h30m40.392501134s) [noise=true , address=81.171.14.70:4043 , piece_id=FQ5SR76KXNGIBI2T7AK3XFLN57YO4H5RBAAESPICBOL2L2FCWHBQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:41532->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625114736 (243h30m40.392798172s) [noise=true , address=81.171.14.70:4045 , piece_id=JC5POJW2ZGLZB6OFTPLS3PK3LAK6AE6SICLVYYP74RY3Z4KQE7IA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: read tcp 159.223.143.39:49638->81.171.14.70:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625409951 (243h30m40.393093382s) [noise=true , address=81.171.14.70:4047 , piece_id=VQN2T44TCUUMBDS23NHRBM2RO5F6TC4WGNQPL4DDRU3A6DQTMBEA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:40864->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625456822 (243h30m40.393140242s) [seg_pos={0 0}, upload=253234]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 21 13:17:15.727844444 (243h30m40.495527869s) [upload=253234]: Done uploading segments... Nov 21 13:17:15.727891684 (243h30m40.495575113s) [upload=253234]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 2.125676897s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.11459607s trace: https://jaeger.dev.storj.io/trace/3e276090513c6d3b FAIL (2025-11-21 13:18:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== 5L3BR7D5JBTEHIGBPAID5EJKUBYNETWMJWHJ5A, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.987498478 (243h29m40.755181917s) [noise=true , address=185.167.204.205:4031 , piece_id=IAZRVIE3YHQTNM22UYM4B7TCBYDA2EUMSNIK7C4R3637NTYHSLRQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.988154860 (243h29m40.755838308s) [noise=true , address=89.149.201.147:4009 , piece_id=BOG3EIF5CLQOJ4QOFVVOIYUVQH3YZBJJ5WKJ6BSE5WOF3NQMK5YA, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.988761968 (243h29m40.756445412s) [noise=true , address=185.167.204.206:4055 , piece_id=T2UM73BIH3KOT5XBVY3ZRQNQ672CPH57OKVVSVHVSFZU2D6PPTXQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.989455702 (243h29m40.757139137s) [noise=true , address=89.149.201.147:4021 , piece_id=ZHXGNV4M2G47UN3H6B2KLND3GBEHFIJ4ZDANVUBRX3SUQGTEFR2A, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.990168101 (243h29m40.757851537s) [noise=true , address=89.149.201.147:4018 , piece_id=2SATC6VJT4HHRCIUJWPSRPQGINCCSXTHVRIOKLHH7GAJ42NNAERA, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.990870219 (243h29m40.758553659s) [noise=true , address=185.167.204.206:4047 , piece_id=RIJHJETENKHV23KNYXZ5SSDOR5VLTSQ64IBSFSIKVCYB4SP35IOQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.991676123 (243h29m40.759359559s) [noise=true , address=81.171.14.70:4043 , piece_id=FQ5SR76KXNGIBI2T7AK3XFLN57YO4H5RBAAESPICBOL2L2FCWHBQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.993530722 (243h29m40.761214161s) [noise=true , address=185.167.204.205:4022 , piece_id=35QCU5FIDBUJQFNCJCHKWDDKGPPDXEDBKCNI5A5VMAS7NXZTTNGQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.995576845 (243h29m40.76326028s) [noise=true , address=81.171.14.70:4028 , piece_id=INCSZCH2ZA23DSDXGXBHICU4YMNGTCDNFISNI2SNADPEKOE4I2RQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:16.417071691 (243h29m41.184755117s) [upload=253234]: Next returned nil segment Nov 21 13:16:16.417088568 (243h29m41.184771994s) [upload=253234]: Waiting for error group managing segments... Nov 21 13:16:16.604253953 (243h29m41.37193741s) [noise=true , address=89.149.201.147:4009 , piece_id=BOG3EIF5CLQOJ4QOFVVOIYUVQH3YZBJJ5WKJ6BSE5WOF3NQMK5YA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.616631034 (243h29m41.384314459s) [noise=true , address=89.149.201.147:4022 , piece_id=S4CD6TBJIQGENSR3OUDZSFNUGEKCKG2KF6GS4DN3YAYF3FCK6BRQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.622248975 (243h29m41.389932404s) [noise=true , address=89.149.201.147:4021 , piece_id=ZHXGNV4M2G47UN3H6B2KLND3GBEHFIJ4ZDANVUBRX3SUQGTEFR2A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.622772397 (243h29m41.390455832s) [noise=true , address=89.149.201.147:4005 , piece_id=JVTLH6W7GNBKF6FI5K56GUKQ7LPWGSNZWV2X3TGFOHUKG2COXJDQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.635671178 (243h29m41.403354603s) [noise=true , address=185.167.204.206:4044 , piece_id=TJO4FHXPZWWLIISBTWLX2H4PDWFDGID2LWQAR7TAJGXM3OO6O73Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.638523014 (243h29m41.406206439s) [noise=true , address=185.167.204.206:4045 , piece_id=W26WUTNYVGHDZ6AA5BPGBRLTCXTS4DVWHYSW7ORP44BBJY7HVD2A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.647706039 (243h29m41.415389468s) [noise=true , address=185.167.204.205:4024 , piece_id=UQU4IGX45QTKY5SY5HEKRVCXDHK6PPYDZDTTKEHUDW6JETPQDUNA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.647997350 (243h29m41.415680775s) [noise=true , address=185.167.204.206:4058 , piece_id=75RVJDMPKHI56JQZBD7Y6NZYEWZCWILQM6IXOLHXFBX3ASOPAZCQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.650444384 (243h29m41.418127809s) [noise=true , address=185.167.204.205:4031 , piece_id=IAZRVIE3YHQTNM22UYM4B7TCBYDA2EUMSNIK7C4R3637NTYHSLRQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.651259970 (243h29m41.418943401s) [noise=true , address=185.167.204.206:4067 , piece_id=DYKO7IR5VSJGEYCEM672JGIDQGB4CIURDQ65FFZTC2TJCJCR4A7Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.653940496 (243h29m41.421623925s) [noise=true , address=185.167.204.205:4028 , piece_id=NUAIVIFVS3PIDLDP4I56II7GROUQ4N5HIGUUJLWEKDJM2HISQK7A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.656238559 (243h29m41.423921984s) [noise=true , address=185.167.204.205:4020 , piece_id=PVVA4UFQEOJNEJ2QXAIFREZEBJBSMOLCB7VVGOH5HR2NK4KELPYA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.658552874 (243h29m41.426236299s) [noise=true , address=185.167.204.206:4047 , piece_id=RIJHJETENKHV23KNYXZ5SSDOR5VLTSQ64IBSFSIKVCYB4SP35IOQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.658795439 (243h29m41.426478865s) [noise=true , address=185.167.204.206:4066 , piece_id=IJX27IPYXELRKHIBF3DLKORJ2IX55LRNAGPOUQEUZ3MPBN7FQCSQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.664043937 (243h29m41.431727378s) [noise=true , address=89.149.201.147:4001 , piece_id=6UMZWXB3BYCP6OZJOFREAYMD66PSUVZSNBBDRRYLWZSDDBAIHHYA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.664924438 (243h29m41.432607866s) [noise=true , address=185.167.204.206:4057 , piece_id=UZUKNSI26BGMZUWQULLZMIN7ZZNGVCYRLLFMNWT7KNLOD5GG65SQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.672162093 (243h29m41.439845519s) [noise=true , address=185.167.204.205:4022 , piece_id=35QCU5FIDBUJQFNCJCHKWDDKGPPDXEDBKCNI5A5VMAS7NXZTTNGQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.675169434 (243h29m41.44285286s) [noise=true , address=185.167.204.206:4063 , piece_id=LZ2MWIOS4OFWTV5L3BR7D5JBTEHIGBPAID5EJKUBYNETWMJWHJ5A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.676639209 (243h29m41.444322635s) [noise=true , address=185.167.204.206:4055 , piece_id=T2UM73BIH3KOT5XBVY3ZRQNQ672CPH57OKVVSVHVSFZU2D6PPTXQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.677425453 (243h29m41.445108879s) [noise=true , address=89.149.201.147:4018 , piece_id=2SATC6VJT4HHRCIUJWPSRPQGINCCSXTHVRIOKLHH7GAJ42NNAERA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:11.897994899 (243h30m36.665678325s) [noise=true , address=81.171.14.70:4025 , piece_id=TAKEHN75NX6RFEFRR5532A6AQJRBCS4REDGNAXJNWQMFWS6EQSWQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:13.995171303 (243h30m38.762854732s) [noise=true , address=81.171.14.70:4036 , piece_id=4KINF6GWQFNK7SEJBXVXTMKMFHWVZ4RRBMBONJEV74AHOYINAI3Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:14.620057026 (243h30m39.38774045s) [noise=true , address=81.171.14.70:4029 , piece_id=2ECO7GGZMVJPC5R6ADCLHXR7BHG5GAJJ5IQ7AIZQ4ND2YL6KR2SA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:15.624633590 (243h30m40.392317019s) [noise=true , address=81.171.14.70:4028 , piece_id=INCSZCH2ZA23DSDXGXBHICU4YMNGTCDNFISNI2SNADPEKOE4I2RQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: read tcp 159.223.143.39:42198->81.171.14.70:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.624764414 (243h30m40.39244785s) [noise=true , address=81.171.14.70:4042 , piece_id=7YOGQYMBBQF3R2AALKZXLJUL5VJII5WMFLUKEUAYTLMLGTIJGDIQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: rpc: dial tcp 81.171.14.70:4042: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.624817700 (243h30m40.392501134s) [noise=true , address=81.171.14.70:4043 , piece_id=FQ5SR76KXNGIBI2T7AK3XFLN57YO4H5RBAAESPICBOL2L2FCWHBQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:41532->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625114736 (243h30m40.392798172s) [noise=true , address=81.171.14.70:4045 , piece_id=JC5POJW2ZGLZB6OFTPLS3PK3LAK6AE6SICLVYYP74RY3Z4KQE7IA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: read tcp 159.223.143.39:49638->81.171.14.70:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625409951 (243h30m40.393093382s) [noise=true , address=81.171.14.70:4047 , piece_id=VQN2T44TCUUMBDS23NHRBM2RO5F6TC4WGNQPL4DDRU3A6DQTMBEA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:40864->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625456822 (243h30m40.393140242s) [seg_pos={0 0}, upload=253234]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 21 13:17:15.727844444 (243h30m40.495527869s) [upload=253234]: Done uploading segments... Nov 21 13:17:15.727891684 (243h30m40.495575113s) [upload=253234]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 2.114632853s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.103477354s trace: https://jaeger.dev.storj.io/trace/3e276090513c6d3b FAIL (2025-11-21 13:17:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== 5L3BR7D5JBTEHIGBPAID5EJKUBYNETWMJWHJ5A, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.987498478 (243h29m40.755181917s) [noise=true , address=185.167.204.205:4031 , piece_id=IAZRVIE3YHQTNM22UYM4B7TCBYDA2EUMSNIK7C4R3637NTYHSLRQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.988154860 (243h29m40.755838308s) [noise=true , address=89.149.201.147:4009 , piece_id=BOG3EIF5CLQOJ4QOFVVOIYUVQH3YZBJJ5WKJ6BSE5WOF3NQMK5YA, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.988761968 (243h29m40.756445412s) [noise=true , address=185.167.204.206:4055 , piece_id=T2UM73BIH3KOT5XBVY3ZRQNQ672CPH57OKVVSVHVSFZU2D6PPTXQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.989455702 (243h29m40.757139137s) [noise=true , address=89.149.201.147:4021 , piece_id=ZHXGNV4M2G47UN3H6B2KLND3GBEHFIJ4ZDANVUBRX3SUQGTEFR2A, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.990168101 (243h29m40.757851537s) [noise=true , address=89.149.201.147:4018 , piece_id=2SATC6VJT4HHRCIUJWPSRPQGINCCSXTHVRIOKLHH7GAJ42NNAERA, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.990870219 (243h29m40.758553659s) [noise=true , address=185.167.204.206:4047 , piece_id=RIJHJETENKHV23KNYXZ5SSDOR5VLTSQ64IBSFSIKVCYB4SP35IOQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.991676123 (243h29m40.759359559s) [noise=true , address=81.171.14.70:4043 , piece_id=FQ5SR76KXNGIBI2T7AK3XFLN57YO4H5RBAAESPICBOL2L2FCWHBQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.993530722 (243h29m40.761214161s) [noise=true , address=185.167.204.205:4022 , piece_id=35QCU5FIDBUJQFNCJCHKWDDKGPPDXEDBKCNI5A5VMAS7NXZTTNGQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.995576845 (243h29m40.76326028s) [noise=true , address=81.171.14.70:4028 , piece_id=INCSZCH2ZA23DSDXGXBHICU4YMNGTCDNFISNI2SNADPEKOE4I2RQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:16.417071691 (243h29m41.184755117s) [upload=253234]: Next returned nil segment Nov 21 13:16:16.417088568 (243h29m41.184771994s) [upload=253234]: Waiting for error group managing segments... Nov 21 13:16:16.604253953 (243h29m41.37193741s) [noise=true , address=89.149.201.147:4009 , piece_id=BOG3EIF5CLQOJ4QOFVVOIYUVQH3YZBJJ5WKJ6BSE5WOF3NQMK5YA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.616631034 (243h29m41.384314459s) [noise=true , address=89.149.201.147:4022 , piece_id=S4CD6TBJIQGENSR3OUDZSFNUGEKCKG2KF6GS4DN3YAYF3FCK6BRQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.622248975 (243h29m41.389932404s) [noise=true , address=89.149.201.147:4021 , piece_id=ZHXGNV4M2G47UN3H6B2KLND3GBEHFIJ4ZDANVUBRX3SUQGTEFR2A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.622772397 (243h29m41.390455832s) [noise=true , address=89.149.201.147:4005 , piece_id=JVTLH6W7GNBKF6FI5K56GUKQ7LPWGSNZWV2X3TGFOHUKG2COXJDQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.635671178 (243h29m41.403354603s) [noise=true , address=185.167.204.206:4044 , piece_id=TJO4FHXPZWWLIISBTWLX2H4PDWFDGID2LWQAR7TAJGXM3OO6O73Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.638523014 (243h29m41.406206439s) [noise=true , address=185.167.204.206:4045 , piece_id=W26WUTNYVGHDZ6AA5BPGBRLTCXTS4DVWHYSW7ORP44BBJY7HVD2A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.647706039 (243h29m41.415389468s) [noise=true , address=185.167.204.205:4024 , piece_id=UQU4IGX45QTKY5SY5HEKRVCXDHK6PPYDZDTTKEHUDW6JETPQDUNA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.647997350 (243h29m41.415680775s) [noise=true , address=185.167.204.206:4058 , piece_id=75RVJDMPKHI56JQZBD7Y6NZYEWZCWILQM6IXOLHXFBX3ASOPAZCQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.650444384 (243h29m41.418127809s) [noise=true , address=185.167.204.205:4031 , piece_id=IAZRVIE3YHQTNM22UYM4B7TCBYDA2EUMSNIK7C4R3637NTYHSLRQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.651259970 (243h29m41.418943401s) [noise=true , address=185.167.204.206:4067 , piece_id=DYKO7IR5VSJGEYCEM672JGIDQGB4CIURDQ65FFZTC2TJCJCR4A7Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.653940496 (243h29m41.421623925s) [noise=true , address=185.167.204.205:4028 , piece_id=NUAIVIFVS3PIDLDP4I56II7GROUQ4N5HIGUUJLWEKDJM2HISQK7A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.656238559 (243h29m41.423921984s) [noise=true , address=185.167.204.205:4020 , piece_id=PVVA4UFQEOJNEJ2QXAIFREZEBJBSMOLCB7VVGOH5HR2NK4KELPYA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.658552874 (243h29m41.426236299s) [noise=true , address=185.167.204.206:4047 , piece_id=RIJHJETENKHV23KNYXZ5SSDOR5VLTSQ64IBSFSIKVCYB4SP35IOQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.658795439 (243h29m41.426478865s) [noise=true , address=185.167.204.206:4066 , piece_id=IJX27IPYXELRKHIBF3DLKORJ2IX55LRNAGPOUQEUZ3MPBN7FQCSQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.664043937 (243h29m41.431727378s) [noise=true , address=89.149.201.147:4001 , piece_id=6UMZWXB3BYCP6OZJOFREAYMD66PSUVZSNBBDRRYLWZSDDBAIHHYA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.664924438 (243h29m41.432607866s) [noise=true , address=185.167.204.206:4057 , piece_id=UZUKNSI26BGMZUWQULLZMIN7ZZNGVCYRLLFMNWT7KNLOD5GG65SQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.672162093 (243h29m41.439845519s) [noise=true , address=185.167.204.205:4022 , piece_id=35QCU5FIDBUJQFNCJCHKWDDKGPPDXEDBKCNI5A5VMAS7NXZTTNGQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.675169434 (243h29m41.44285286s) [noise=true , address=185.167.204.206:4063 , piece_id=LZ2MWIOS4OFWTV5L3BR7D5JBTEHIGBPAID5EJKUBYNETWMJWHJ5A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.676639209 (243h29m41.444322635s) [noise=true , address=185.167.204.206:4055 , piece_id=T2UM73BIH3KOT5XBVY3ZRQNQ672CPH57OKVVSVHVSFZU2D6PPTXQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.677425453 (243h29m41.445108879s) [noise=true , address=89.149.201.147:4018 , piece_id=2SATC6VJT4HHRCIUJWPSRPQGINCCSXTHVRIOKLHH7GAJ42NNAERA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:11.897994899 (243h30m36.665678325s) [noise=true , address=81.171.14.70:4025 , piece_id=TAKEHN75NX6RFEFRR5532A6AQJRBCS4REDGNAXJNWQMFWS6EQSWQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:13.995171303 (243h30m38.762854732s) [noise=true , address=81.171.14.70:4036 , piece_id=4KINF6GWQFNK7SEJBXVXTMKMFHWVZ4RRBMBONJEV74AHOYINAI3Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:14.620057026 (243h30m39.38774045s) [noise=true , address=81.171.14.70:4029 , piece_id=2ECO7GGZMVJPC5R6ADCLHXR7BHG5GAJJ5IQ7AIZQ4ND2YL6KR2SA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:15.624633590 (243h30m40.392317019s) [noise=true , address=81.171.14.70:4028 , piece_id=INCSZCH2ZA23DSDXGXBHICU4YMNGTCDNFISNI2SNADPEKOE4I2RQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: read tcp 159.223.143.39:42198->81.171.14.70:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.624764414 (243h30m40.39244785s) [noise=true , address=81.171.14.70:4042 , piece_id=7YOGQYMBBQF3R2AALKZXLJUL5VJII5WMFLUKEUAYTLMLGTIJGDIQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: rpc: dial tcp 81.171.14.70:4042: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.624817700 (243h30m40.392501134s) [noise=true , address=81.171.14.70:4043 , piece_id=FQ5SR76KXNGIBI2T7AK3XFLN57YO4H5RBAAESPICBOL2L2FCWHBQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:41532->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625114736 (243h30m40.392798172s) [noise=true , address=81.171.14.70:4045 , piece_id=JC5POJW2ZGLZB6OFTPLS3PK3LAK6AE6SICLVYYP74RY3Z4KQE7IA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: read tcp 159.223.143.39:49638->81.171.14.70:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625409951 (243h30m40.393093382s) [noise=true , address=81.171.14.70:4047 , piece_id=VQN2T44TCUUMBDS23NHRBM2RO5F6TC4WGNQPL4DDRU3A6DQTMBEA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:40864->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625456822 (243h30m40.393140242s) [seg_pos={0 0}, upload=253234]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 21 13:17:15.727844444 (243h30m40.495527869s) [upload=253234]: Done uploading segments... Nov 21 13:17:15.727891684 (243h30m40.495575113s) [upload=253234]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 2.103494291s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.106443827s trace: https://jaeger.dev.storj.io/trace/3e276090513c6d3b FAIL (2025-11-21 13:17:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 23) ======LOGS====== 5L3BR7D5JBTEHIGBPAID5EJKUBYNETWMJWHJ5A, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.987498478 (243h29m40.755181917s) [noise=true , address=185.167.204.205:4031 , piece_id=IAZRVIE3YHQTNM22UYM4B7TCBYDA2EUMSNIK7C4R3637NTYHSLRQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.988154860 (243h29m40.755838308s) [noise=true , address=89.149.201.147:4009 , piece_id=BOG3EIF5CLQOJ4QOFVVOIYUVQH3YZBJJ5WKJ6BSE5WOF3NQMK5YA, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.988761968 (243h29m40.756445412s) [noise=true , address=185.167.204.206:4055 , piece_id=T2UM73BIH3KOT5XBVY3ZRQNQ672CPH57OKVVSVHVSFZU2D6PPTXQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.989455702 (243h29m40.757139137s) [noise=true , address=89.149.201.147:4021 , piece_id=ZHXGNV4M2G47UN3H6B2KLND3GBEHFIJ4ZDANVUBRX3SUQGTEFR2A, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.990168101 (243h29m40.757851537s) [noise=true , address=89.149.201.147:4018 , piece_id=2SATC6VJT4HHRCIUJWPSRPQGINCCSXTHVRIOKLHH7GAJ42NNAERA, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.990870219 (243h29m40.758553659s) [noise=true , address=185.167.204.206:4047 , piece_id=RIJHJETENKHV23KNYXZ5SSDOR5VLTSQ64IBSFSIKVCYB4SP35IOQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.991676123 (243h29m40.759359559s) [noise=true , address=81.171.14.70:4043 , piece_id=FQ5SR76KXNGIBI2T7AK3XFLN57YO4H5RBAAESPICBOL2L2FCWHBQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.993530722 (243h29m40.761214161s) [noise=true , address=185.167.204.205:4022 , piece_id=35QCU5FIDBUJQFNCJCHKWDDKGPPDXEDBKCNI5A5VMAS7NXZTTNGQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:15.995576845 (243h29m40.76326028s) [noise=true , address=81.171.14.70:4028 , piece_id=INCSZCH2ZA23DSDXGXBHICU4YMNGTCDNFISNI2SNADPEKOE4I2RQ, seg_pos={0 0}, upload=253234]: Uploading piece... Nov 21 13:16:16.417071691 (243h29m41.184755117s) [upload=253234]: Next returned nil segment Nov 21 13:16:16.417088568 (243h29m41.184771994s) [upload=253234]: Waiting for error group managing segments... Nov 21 13:16:16.604253953 (243h29m41.37193741s) [noise=true , address=89.149.201.147:4009 , piece_id=BOG3EIF5CLQOJ4QOFVVOIYUVQH3YZBJJ5WKJ6BSE5WOF3NQMK5YA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.616631034 (243h29m41.384314459s) [noise=true , address=89.149.201.147:4022 , piece_id=S4CD6TBJIQGENSR3OUDZSFNUGEKCKG2KF6GS4DN3YAYF3FCK6BRQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.622248975 (243h29m41.389932404s) [noise=true , address=89.149.201.147:4021 , piece_id=ZHXGNV4M2G47UN3H6B2KLND3GBEHFIJ4ZDANVUBRX3SUQGTEFR2A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.622772397 (243h29m41.390455832s) [noise=true , address=89.149.201.147:4005 , piece_id=JVTLH6W7GNBKF6FI5K56GUKQ7LPWGSNZWV2X3TGFOHUKG2COXJDQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.635671178 (243h29m41.403354603s) [noise=true , address=185.167.204.206:4044 , piece_id=TJO4FHXPZWWLIISBTWLX2H4PDWFDGID2LWQAR7TAJGXM3OO6O73Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.638523014 (243h29m41.406206439s) [noise=true , address=185.167.204.206:4045 , piece_id=W26WUTNYVGHDZ6AA5BPGBRLTCXTS4DVWHYSW7ORP44BBJY7HVD2A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.647706039 (243h29m41.415389468s) [noise=true , address=185.167.204.205:4024 , piece_id=UQU4IGX45QTKY5SY5HEKRVCXDHK6PPYDZDTTKEHUDW6JETPQDUNA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.647997350 (243h29m41.415680775s) [noise=true , address=185.167.204.206:4058 , piece_id=75RVJDMPKHI56JQZBD7Y6NZYEWZCWILQM6IXOLHXFBX3ASOPAZCQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.650444384 (243h29m41.418127809s) [noise=true , address=185.167.204.205:4031 , piece_id=IAZRVIE3YHQTNM22UYM4B7TCBYDA2EUMSNIK7C4R3637NTYHSLRQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.651259970 (243h29m41.418943401s) [noise=true , address=185.167.204.206:4067 , piece_id=DYKO7IR5VSJGEYCEM672JGIDQGB4CIURDQ65FFZTC2TJCJCR4A7Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.653940496 (243h29m41.421623925s) [noise=true , address=185.167.204.205:4028 , piece_id=NUAIVIFVS3PIDLDP4I56II7GROUQ4N5HIGUUJLWEKDJM2HISQK7A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.656238559 (243h29m41.423921984s) [noise=true , address=185.167.204.205:4020 , piece_id=PVVA4UFQEOJNEJ2QXAIFREZEBJBSMOLCB7VVGOH5HR2NK4KELPYA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.658552874 (243h29m41.426236299s) [noise=true , address=185.167.204.206:4047 , piece_id=RIJHJETENKHV23KNYXZ5SSDOR5VLTSQ64IBSFSIKVCYB4SP35IOQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.658795439 (243h29m41.426478865s) [noise=true , address=185.167.204.206:4066 , piece_id=IJX27IPYXELRKHIBF3DLKORJ2IX55LRNAGPOUQEUZ3MPBN7FQCSQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.664043937 (243h29m41.431727378s) [noise=true , address=89.149.201.147:4001 , piece_id=6UMZWXB3BYCP6OZJOFREAYMD66PSUVZSNBBDRRYLWZSDDBAIHHYA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.664924438 (243h29m41.432607866s) [noise=true , address=185.167.204.206:4057 , piece_id=UZUKNSI26BGMZUWQULLZMIN7ZZNGVCYRLLFMNWT7KNLOD5GG65SQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.672162093 (243h29m41.439845519s) [noise=true , address=185.167.204.205:4022 , piece_id=35QCU5FIDBUJQFNCJCHKWDDKGPPDXEDBKCNI5A5VMAS7NXZTTNGQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.675169434 (243h29m41.44285286s) [noise=true , address=185.167.204.206:4063 , piece_id=LZ2MWIOS4OFWTV5L3BR7D5JBTEHIGBPAID5EJKUBYNETWMJWHJ5A, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.676639209 (243h29m41.444322635s) [noise=true , address=185.167.204.206:4055 , piece_id=T2UM73BIH3KOT5XBVY3ZRQNQ672CPH57OKVVSVHVSFZU2D6PPTXQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:16:16.677425453 (243h29m41.445108879s) [noise=true , address=89.149.201.147:4018 , piece_id=2SATC6VJT4HHRCIUJWPSRPQGINCCSXTHVRIOKLHH7GAJ42NNAERA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:11.897994899 (243h30m36.665678325s) [noise=true , address=81.171.14.70:4025 , piece_id=TAKEHN75NX6RFEFRR5532A6AQJRBCS4REDGNAXJNWQMFWS6EQSWQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:13.995171303 (243h30m38.762854732s) [noise=true , address=81.171.14.70:4036 , piece_id=4KINF6GWQFNK7SEJBXVXTMKMFHWVZ4RRBMBONJEV74AHOYINAI3Q, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:14.620057026 (243h30m39.38774045s) [noise=true , address=81.171.14.70:4029 , piece_id=2ECO7GGZMVJPC5R6ADCLHXR7BHG5GAJJ5IQ7AIZQ4ND2YL6KR2SA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: <nil> Nov 21 13:17:15.624633590 (243h30m40.392317019s) [noise=true , address=81.171.14.70:4028 , piece_id=INCSZCH2ZA23DSDXGXBHICU4YMNGTCDNFISNI2SNADPEKOE4I2RQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12s7cAtvSQB3RQj5km8v3n2gDvwTiBAB7h4cijTE951tPoytDed, address:81.171.14.70:4028): protocol: read tcp 159.223.143.39:42198->81.171.14.70:4028: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.624764414 (243h30m40.39244785s) [noise=true , address=81.171.14.70:4042 , piece_id=7YOGQYMBBQF3R2AALKZXLJUL5VJII5WMFLUKEUAYTLMLGTIJGDIQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12vBozgWFrZfUEQAwsqBt6CDMW47rVjZaDfvKTsCdPrvX8swkhD, address:81.171.14.70:4042): protocol: rpc: dial tcp 81.171.14.70:4042: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.624817700 (243h30m40.392501134s) [noise=true , address=81.171.14.70:4043 , piece_id=FQ5SR76KXNGIBI2T7AK3XFLN57YO4H5RBAAESPICBOL2L2FCWHBQ, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:41532->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625114736 (243h30m40.392798172s) [noise=true , address=81.171.14.70:4045 , piece_id=JC5POJW2ZGLZB6OFTPLS3PK3LAK6AE6SICLVYYP74RY3Z4KQE7IA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:12WCMeEEkwoqbPeyENfJt6nahQz2h3yW7st1TtvoY6KDKZqUGmS, address:81.171.14.70:4045): protocol: read tcp 159.223.143.39:49638->81.171.14.70:4045: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625409951 (243h30m40.393093382s) [noise=true , address=81.171.14.70:4047 , piece_id=VQN2T44TCUUMBDS23NHRBM2RO5F6TC4WGNQPL4DDRU3A6DQTMBEA, seg_pos={0 0}, upload=253234]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:40864->81.171.14.70:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:17:15.625456822 (243h30m40.393140242s) [seg_pos={0 0}, upload=253234]: Done waiting for segment. successful: 23 optimal: 26 errs: <nil> Nov 21 13:17:15.727844444 (243h30m40.495527869s) [upload=253234]: Done uploading segments... Nov 21 13:17:15.727891684 (243h30m40.495575113s) [upload=253234]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 23) Duration: 1m0.106465169s core uplink eu-select-1 eu1-placement-15
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [X...........................................................] duration: 279.817781ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/7639da20b138b74c FAIL (2025-11-21 12:52:43 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 279.842193ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 256.126742ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/5cc04ccc1221550c FAIL (2025-11-21 12:52:27 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded Duration: 256.364266ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 2 out of 60 is failed (threshold=6) [XX..........................................................] duration: 277.093407ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/7639da20b138b74c FAIL (2025-11-21 12:52:23 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 277.118885ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 3 out of 60 is failed (threshold=6) [XXX.........................................................] duration: 266.521323ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/7639da20b138b74c FAIL (2025-11-21 12:51:54 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 266.549845ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 2 out of 60 is failed (threshold=3) [XX..........................................................] duration: 717.435785ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/5cc04ccc1221550c FAIL (2025-11-21 12:51:19 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded Duration: 717.46918ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 4 out of 60 is failed (threshold=6) [XXXX........................................................] duration: 247.098602ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/7639da20b138b74c FAIL (2025-11-21 12:51:10 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 247.121931ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 3 out of 60 is failed (threshold=3) [XXX.........................................................] duration: 261.721772ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/5cc04ccc1221550c FAIL (2025-11-21 12:50:37 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded Duration: 261.750533ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 5 out of 60 is failed (threshold=6) [XXXXX.......................................................] duration: 273.807569ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/7639da20b138b74c FAIL (2025-11-21 12:50:32 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 273.830401ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 6 out of 60 is failed (threshold=6) [XXXXXX......................................................] duration: 257.707451ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/7639da20b138b74c FAIL (2025-11-21 12:50:01 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 257.734166ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 4 out of 60 is failed (threshold=3) [XXXX........................................................] duration: 739.867743ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/5cc04ccc1221550c FAIL (2025-11-21 12:49:55 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded Duration: 739.909329ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 5 out of 60 is failed (threshold=3) [XXXXX.......................................................] duration: 268.868222ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/5cc04ccc1221550c FAIL (2025-11-21 12:49:16 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded Duration: 268.892415ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 7 out of 60 is failed (threshold=6) [XXXXXXX.....................................................] duration: 271.730893ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/7639da20b138b74c FAIL (2025-11-21 12:48:53 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 271.757342ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 6 out of 60 is failed (threshold=3) [XXXXXX......................................................] duration: 266.137965ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/5cc04ccc1221550c FAIL (2025-11-21 12:48:37 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded Duration: 266.257478ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 8 out of 60 is failed (threshold=6) [XXXXXXXX....................................................] duration: 747.093812ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/7639da20b138b74c FAIL (2025-11-21 12:48:04 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 747.118709ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 6 out of 60 is failed (threshold=3) [.XXXXXX.....................................................] duration: 266.72313ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/5cc04ccc1221550c FAIL (2025-11-21 12:47:52 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded Duration: 266.813218ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 8 out of 60 is failed (threshold=6) [.XXXXXXXX...................................................] duration: 255.878099ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/7639da20b138b74c FAIL (2025-11-21 12:47:43 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 255.904912ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 7 out of 60 is failed (threshold=3) [X.XXXXXX....................................................] duration: 269.479013ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/5cc04ccc1221550c FAIL (2025-11-21 12:47:25 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded Duration: 269.520029ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 9 out of 60 is failed (threshold=6) [X.XXXXXXXX..................................................] duration: 252.107566ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/7639da20b138b74c FAIL (2025-11-21 12:47:05 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 252.132201ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 10 out of 60 is failed (threshold=6) [XX.XXXXXXXX.................................................] duration: 265.038908ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/7639da20b138b74c FAIL (2025-11-21 12:46:40 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 265.072656ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 8 out of 60 is failed (threshold=3) [XX.XXXXXX...................................................] duration: 271.656733ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/5cc04ccc1221550c FAIL (2025-11-21 12:46:23 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded Duration: 271.681429ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 9 out of 60 is failed (threshold=3) [XXX.XXXXXX..................................................] duration: 750.922392ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/5cc04ccc1221550c FAIL (2025-11-21 12:46:01 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded Duration: 750.943711ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 11 out of 60 is failed (threshold=6) [XXX.XXXXXXXX................................................] duration: 269.365348ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/7639da20b138b74c FAIL (2025-11-21 12:45:52 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 269.388792ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway) antiblip: 10 out of 60 is failed (threshold=3) [XXXX.XXXXXX.................................................] duration: 259.897571ms remote: "tcp:136.0.77.2:443" target: https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace: https://jaeger.dev.storj.io/trace/5cc04ccc1221550c FAIL (2025-11-21 12:44:54 UTC) orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded Duration: 259.919193ms edge gateway vhost bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 12 out of 60 is failed (threshold=6) [XXXX.XXXXXXXX...............................................] duration: 261.186598ms remote: "tcp:136.0.77.2:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/7639da20b138b74c FAIL (2025-11-21 12:44:39 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 261.211549ms edge linksharing bgp ap1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)