Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 1.278821834s trace: https://jaeger.dev.storj.io/trace/4614e3dceaeb8139 FAIL (2025-11-22 11:35:42 UTC) orbiter warning: context deadline exceeded Duration: 1.278845409s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 505.522958ms trace: https://jaeger.dev.storj.io/trace/4614e3dceaeb8139 FAIL (2025-11-22 11:35:26 UTC) orbiter warning: context deadline exceeded Duration: 505.553883ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 1.270937959s trace: https://jaeger.dev.storj.io/trace/4614e3dceaeb8139 FAIL (2025-11-22 11:35:07 UTC) orbiter warning: context deadline exceeded Duration: 1.270998991s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 535.590616ms trace: https://jaeger.dev.storj.io/trace/4614e3dceaeb8139 FAIL (2025-11-22 11:34:38 UTC) orbiter warning: context deadline exceeded Duration: 535.620295ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 579.730774ms trace: https://jaeger.dev.storj.io/trace/4614e3dceaeb8139 FAIL (2025-11-22 11:33:30 UTC) orbiter warning: context deadline exceeded Duration: 579.76102ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 565.197212ms trace: https://jaeger.dev.storj.io/trace/4614e3dceaeb8139 FAIL (2025-11-22 11:32:36 UTC) orbiter warning: context deadline exceeded Duration: 565.224551ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 993.815366ms trace: https://jaeger.dev.storj.io/trace/4614e3dceaeb8139 FAIL (2025-11-22 11:31:53 UTC) orbiter warning: context deadline exceeded Duration: 993.898447ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 1.386111077s trace: https://jaeger.dev.storj.io/trace/4614e3dceaeb8139 FAIL (2025-11-22 11:31:18 UTC) orbiter warning: context deadline exceeded Duration: 1.386135155s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 564.324661ms trace: https://jaeger.dev.storj.io/trace/4614e3dceaeb8139 FAIL (2025-11-22 11:30:32 UTC) orbiter warning: context deadline exceeded Duration: 564.398284ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 1.50839242s trace: https://jaeger.dev.storj.io/trace/4614e3dceaeb8139 FAIL (2025-11-22 11:29:59 UTC) orbiter warning: context deadline exceeded Duration: 1.508416809s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 525.207511ms trace: https://jaeger.dev.storj.io/trace/4614e3dceaeb8139 FAIL (2025-11-22 11:29:20 UTC) orbiter warning: context deadline exceeded Duration: 525.231799ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 559.484736ms trace: https://jaeger.dev.storj.io/trace/4614e3dceaeb8139 FAIL (2025-11-22 11:28:43 UTC) orbiter warning: context deadline exceeded Duration: 559.53722ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 36.016114225s trace: https://jaeger.dev.storj.io/trace/4614e3dceaeb8139 FAIL (2025-11-22 11:28:42 UTC) orbiter warning: context deadline exceeded Duration: 36.01613504s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 534.680479ms trace: https://jaeger.dev.storj.io/trace/4614e3dceaeb8139 FAIL (2025-11-22 11:27:08 UTC) orbiter warning: context deadline exceeded Duration: 534.703557ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 503.843727ms trace: https://jaeger.dev.storj.io/trace/4614e3dceaeb8139 FAIL (2025-11-22 11:26:05 UTC) orbiter warning: context deadline exceeded Duration: 503.865043ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 1.11126089s trace: https://jaeger.dev.storj.io/trace/4614e3dceaeb8139 FAIL (2025-11-22 11:25:32 UTC) orbiter warning: context deadline exceeded Duration: 1.111289042s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 1.591366989s trace: https://jaeger.dev.storj.io/trace/4614e3dceaeb8139 FAIL (2025-11-22 11:24:53 UTC) orbiter warning: context deadline exceeded Duration: 1.591400695s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 776.891855ms trace: https://jaeger.dev.storj.io/trace/4614e3dceaeb8139 FAIL (2025-11-22 11:23:51 UTC) orbiter warning: context deadline exceeded Duration: 776.919759ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 1.601369637s trace: https://jaeger.dev.storj.io/trace/4614e3dceaeb8139 FAIL (2025-11-22 11:23:06 UTC) orbiter warning: context deadline exceeded Duration: 1.601396016s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 514.954924ms trace: https://jaeger.dev.storj.io/trace/4614e3dceaeb8139 FAIL (2025-11-22 11:22:30 UTC) orbiter warning: context deadline exceeded Duration: 515.000543ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 794.973264ms trace: https://jaeger.dev.storj.io/trace/4614e3dceaeb8139 FAIL (2025-11-22 11:21:54 UTC) orbiter warning: context deadline exceeded Duration: 795.084138ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 579.934015ms trace: https://jaeger.dev.storj.io/trace/4614e3dceaeb8139 FAIL (2025-11-22 11:21:09 UTC) orbiter warning: context deadline exceeded Duration: 579.945992ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.001337151s trace: https://jaeger.dev.storj.io/trace/4614e3dceaeb8139 FAIL (2025-11-22 11:21:08 UTC) orbiter warning: context deadline exceeded Duration: 1m0.001361114s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.037610327s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:20:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.037823398s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.129825118s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:20:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.129852388s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.08762307s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:19:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.087648456s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [X..X........................................................] duration: 2.104392974s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:19:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.104421637s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.X..X.......................................................] duration: 2.05137738s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:18:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.051423431s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [..X..X......................................................] duration: 2.069494171s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:17:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.069521777s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [...X..X.....................................................] duration: 2.121376685s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:16:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.121417709s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [....X..X....................................................] duration: 2.054131183s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:15:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.054184137s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.....X..X...................................................] duration: 2.083746471s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:14:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.083780899s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [......X..X..................................................] duration: 2.097126388s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:13:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.097174817s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [X......X..X.................................................] duration: 2.105861945s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:13:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.105889431s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [.X......X..X................................................] duration: 2.003795222s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:12:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.003871343s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [..X......X..X...............................................] duration: 2.03265617s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:11:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.032741011s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [...X......X..X..............................................] duration: 2.046923598s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:11:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.046951392s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [....X......X..X.............................................] duration: 2.068168531s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:09:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.06820768s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [.....X......X..X............................................] duration: 2.005918981s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:09:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.005945603s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [......X......X..X...........................................] duration: 1.983640869s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:08:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 1.983670523s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [.......X......X..X..........................................] duration: 2.037046462s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:07:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.037071758s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [........X......X..X.........................................] duration: 2.051200014s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:07:13 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.051229504s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [.........X......X..X........................................] duration: 2.035516359s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:06:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.035542407s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [..........X......X..X.......................................] duration: 2.066150252s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:05:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.066189485s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [...........X......X..X......................................] duration: 2.069047036s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:04:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.069071453s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [............X......X..X.....................................] duration: 2.06836473s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:03:12 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.068392374s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 3 out of 60 is failed (threshold=3) [.............X......X..X....................................] duration: 2.028153654s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:02:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.028180047s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [X.............X......X..X...................................] duration: 2.073931428s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:01:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.073944554s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [.X.............X......X..X..................................] duration: 2.063601256s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:01:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.063664222s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 4 out of 60 is failed (threshold=3) [..X.............X......X..X.................................] duration: 2.033044138s trace: https://jaeger.dev.storj.io/trace/1ceac303c5805a76 FAIL (2025-11-21 14:00:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 22) ======LOGS====== 43h48m35.524163294s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.756943883 (243h48m35.524627319s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.757542779 (243h48m35.525226219s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758107927 (243h48m35.525791362s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758559045 (243h48m35.526242473s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.758881111 (243h48m35.526564539s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759265894 (243h48m35.526949322s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:10.759704521 (243h48m35.527387949s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Uploading piece... Nov 21 13:35:11.182009081 (243h48m35.949692495s) [upload=253559]: Next returned nil segment Nov 21 13:35:11.182025610 (243h48m35.949709035s) [upload=253559]: Waiting for error group managing segments... Nov 21 13:35:11.355680428 (243h48m36.123363853s) [noise=true , address=185.167.204.205:4011 , piece_id=FHKFKRKHOFD3ZQON45KJH4JBNOA4EMF3GEDJU46VA3WJ5FKRYGLA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.358870518 (243h48m36.126553944s) [noise=true , address=89.149.201.147:4022 , piece_id=OEFG2IZHLM6XXVBZMNQE65KHFAB4XKE6O6PZYP43RDB2A4TOOBFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.359540290 (243h48m36.127223722s) [noise=true , address=89.149.201.147:4023 , piece_id=UUSTPCFGNYWC7R6UT7V5N6B3DIITWVQQHUTU3MEBX7HWDECO2H7A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.363779670 (243h48m36.131463096s) [noise=true , address=89.149.201.147:4021 , piece_id=47YCIHTXSK4G4NM6WMT7UM7DRTJNDG4IAZBIEHCPWXHX3RP4CMQQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.365608652 (243h48m36.133292077s) [noise=true , address=185.167.204.205:4021 , piece_id=SHWRITE7XJUFKCN5OMMEJUNTGL54236H6TXRCNKXLM7645ACTFRA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.367705004 (243h48m36.13538843s) [noise=true , address=185.167.204.205:4024 , piece_id=COML5EWYA6E674OR5EZAEPHO5SHQUHF36ZM5XI57HFDU7YRSZI6A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.370494380 (243h48m36.138177805s) [noise=true , address=185.167.204.205:4002 , piece_id=LBM6IBKLZ7UDYNZ5KJBH2ORKEG7LXQCFP3L4UP637S26WZSBHFMA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371169012 (243h48m36.138852437s) [noise=true , address=185.167.204.205:4033 , piece_id=IHFVLOD6TQDY7MKT6AV3VULADFXOBAMC4BJJHCL3G6KXQYJ6TW3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.371706951 (243h48m36.139390377s) [noise=true , address=89.149.201.147:4012 , piece_id=WBKP3WL3KX2QFJTSCQ4GU2ONCKEWTYLULLXW2O3PC65HDGTCNHEQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.374952675 (243h48m36.142636117s) [noise=true , address=185.167.204.205:4008 , piece_id=FHKTELRARNYWH5ZFBNDJ77Y743EOWUSXN7DRBGV4J2NUXMQDTHUQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.375762446 (243h48m36.143445879s) [noise=true , address=185.167.204.206:4069 , piece_id=X42Z37KHXBANC3UCNTJKFA2NPKTPSK2NMTZ2ODTCBH46FXJWZ6TQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.377560263 (243h48m36.145243689s) [noise=true , address=89.149.201.147:4015 , piece_id=JRZPYFRHOIY27DKIYEZNCGD3BBJ345S5JYJXW7D75KM6LCWYHJDA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.396560090 (243h48m36.164243517s) [noise=true , address=185.167.204.205:4017 , piece_id=CWZLKHXQAGEM4366GKFZECOPMZOHY65I4B7L6D7QLJN6KB2ZHKJA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.398024755 (243h48m36.165708184s) [noise=true , address=185.167.204.206:4057 , piece_id=O5QZMCBMMEQZHGTXWHOPCOMK3OJFPTI32JN3YWXNKLER7CUBZSTQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.406017502 (243h48m36.173700927s) [noise=true , address=185.167.204.206:4040 , piece_id=WT4D434U2DTR4XUDJFY66LIRS6MIT474H2Y5KPZUKGD7EV3IYAHQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.410651765 (243h48m36.17833519s) [noise=true , address=185.167.204.205:4013 , piece_id=HB554GATUG6I5DA4CFMDCIB5XJNVGCNKE2G7WGXSBZYXMBPKD3UA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.427128668 (243h48m36.194812097s) [noise=true , address=185.167.204.206:4045 , piece_id=MKDELKYJ7TFDBGIVUAGWXJO237MWY4UZ6NV3MQYWFM6OWGK4PCXQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.441402604 (243h48m36.209086019s) [noise=true , address=89.149.201.147:4005 , piece_id=7TPJVCXJ4XRUY4SS4VKBH5JVEXNSYAKZJNPVEGF5JO23W3HIVD2A, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:35:11.847498714 (243h48m36.615182139s) [noise=true , address=89.149.201.147:4003 , piece_id=7IFUJMAFQUT2PD2AQURRMOK77XRWJNYXUSULNBST2JFDLQYHHLKQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:08.504957541 (243h49m33.272640969s) [noise=true , address=81.171.14.70:4045 , piece_id=EGJICCGLQCWWST63SOUDQI2V4E6AWGZNC52BKYHVDRDIVTQ5M6XQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.183969545 (243h49m34.951652973s) [noise=true , address=81.171.14.70:4028 , piece_id=DTN7XS53W5WASXGWM37L2R7HHTHCIO4P2HN4XVLDUN2XY4TBXLLQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.197432873 (243h49m34.965116299s) [noise=true , address=81.171.14.70:4042 , piece_id=KHKYACTDXPZUFYJ757LVSTCCM4W5IASQRTW3BMF6PLUR2TAS2HYQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: <nil> Nov 21 13:36:10.376761774 (243h49m35.144445208s) [noise=true , address=81.171.14.70:4043 , piece_id=KUGUYW2YPMXSTHSEU5WFGD4VNOYP3SYEI2JUKGWLBQM2HAEJ4AFQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12o3f1bhpf5JrqLvdu57xT2JFxNwAzkUT4bW8qdjn5nbJ1mQDko, address:81.171.14.70:4043): protocol: read tcp 159.223.143.39:53636->81.171.14.70:4043: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.376834451 (243h49m35.14451788s) [noise=true , address=81.171.14.70:4027 , piece_id=47FSACD66MA5VXG5AREJQQFYGBOF2DJTW3SZWWI3XSM2DTEOLF3Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:122cYvgTxSvC2aEXnBkRk2o8ARTBXj9gqPoa12vW8hogSN6kpA4, address:81.171.14.70:4027): protocol: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:58782->81.171.14.70:4027: use of closed network connection Nov 21 13:36:10.377012589 (243h49m35.144696026s) [noise=true , address=81.171.14.70:4029 , piece_id=DUCVMNMXPYNKJBSYK2CATN2LWLAUFBKAITLVQJH7JL4J3RNVD5AA, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:18yEfU2X4jSrom1JDtQ22cUEvomcg91ohvay2Nsr1Vr8juo9to, address:81.171.14.70:4029): protocol: rpc: dial tcp 81.171.14.70:4029: i/o timeout; context deadline exceeded Nov 21 13:36:10.377110620 (243h49m35.144794046s) [noise=true , address=81.171.14.70:4036 , piece_id=TAXBPVVIPVRG6B2NHL7CRP6UHERHLU2WORIIRPF2KPSZITGGC66Q, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:12TcRxUCpNQVo3KLtKPK1zc6NXR4AdRCvqH4gtxticRH5MrKhVq, address:81.171.14.70:4036): protocol: read tcp 159.223.143.39:59156->81.171.14.70:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377354708 (243h49m35.145038133s) [noise=true , address=81.171.14.70:4033 , piece_id=3SDWYP22GBRL6RFIJGXAUCTIS476UXMD765AG6M5DCRUI7TYH4DQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1BnjusiXEfHYwTDL8soMkm8GYnhbkwy2oCAxVA7oiDyhFXozZ8, address:81.171.14.70:4033): protocol: read tcp 159.223.143.39:50044->81.171.14.70:4033: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Nov 21 13:36:10.377611178 (243h49m35.145294612s) [noise=true , address=81.171.14.70:4047 , piece_id=IYT6R22QN5W4LB3SII63LNU3T4TIVYI45RCPDYWQLMQG6VCEL3GQ, seg_pos={0 0}, upload=253559]: Done uploading piece. err: ecclient: upload failed (node:1bHiz99nonr7kwp4RLRvZdvKUJW3gVB3tx5vpDDbfijn2qrF2m, address:81.171.14.70:4047): protocol: read tcp 159.223.143.39:39566->81.171.14.70:4047: use of closed network connection; context deadline exceeded Nov 21 13:36:10.377641150 (243h49m35.145324565s) [seg_pos={0 0}, upload=253559]: Done waiting for segment. successful: 22 optimal: 26 errs: <nil> Nov 21 13:36:10.471157257 (243h49m35.238840686s) [upload=253559]: Done uploading segments... Nov 21 13:36:10.471192419 (243h49m35.238875845s) [upload=253559]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 22) Duration: 2.033088952s core uplink eu-select-1 eu1-placement-15

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)