Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
649.063576ms
FAIL (2025-07-08 21:06:37 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 649.101067ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
800.110143ms
FAIL (2025-07-08 21:05:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 800.133553ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
1.375889327s
FAIL (2025-07-08 21:05:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.375945458s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
1.591449635s
FAIL (2025-07-08 21:04:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.591473461s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
903.440288ms
FAIL (2025-07-08 21:03:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 903.484275ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
549.610849ms
FAIL (2025-07-08 21:03:00 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 549.693204ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
1.524015671s
FAIL (2025-07-08 21:02:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.52404971s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
906.366429ms
FAIL (2025-07-08 21:01:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 906.447234ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
638.084901ms
FAIL (2025-07-08 21:00:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 638.205775ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
1.521486123s
FAIL (2025-07-08 21:00:01 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.521511212s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
1.63974431s
FAIL (2025-07-08 20:59:01 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.64018851s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
1.898091109s
FAIL (2025-07-08 20:58:25 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.898115723s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
1.472433054s
FAIL (2025-07-08 20:57:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.472782198s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
8.501100428s
FAIL (2025-07-08 20:56:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 8.5014929s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
3.867031796s
FAIL (2025-07-08 20:55:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.867053066s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
645.74966ms
FAIL (2025-07-08 20:54:04 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 645.777129ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
1.471650115s
FAIL (2025-07-08 20:53:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.471671006s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
867.623876ms
FAIL (2025-07-08 20:52:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 867.650445ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
1.482387177s
FAIL (2025-07-08 20:52:17 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.482415565s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
510.612253ms
FAIL (2025-07-08 20:51:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 510.66185ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
644.850076ms
FAIL (2025-07-08 20:51:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 644.875266ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
513.432029ms
FAIL (2025-07-08 20:51:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 513.47687ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
494.289465ms
FAIL (2025-07-08 20:50:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 494.33969ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
2.413327153s
FAIL (2025-07-08 20:50:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.413354033s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
688.958886ms
FAIL (2025-07-08 20:50:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 689.026273ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
631.205285ms
FAIL (2025-07-08 20:49:25 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 631.228526ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
2.769792817s
FAIL (2025-07-08 20:48:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.769820085s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
1.497055876s
FAIL (2025-07-08 20:47:34 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.497084981s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
1.060590839s
FAIL (2025-07-08 20:46:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.060614245s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.018816527s
FAIL (2025-07-08 20:45:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.019022259s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
907.312463ms
FAIL (2025-07-08 20:44:28 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 908.279419ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
745.002237ms
FAIL (2025-07-08 20:43:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 745.029561ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
918.197598ms
FAIL (2025-07-08 20:43:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 918.219407ms
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
1.902306959s
FAIL (2025-07-08 20:42:33 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.902327762s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.00072964s
FAIL (2025-07-08 20:42:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.000752095s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
430.956578ms
FAIL (2025-07-08 05:47:25 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 8)
======LOGS======
pload=284991]: Uploading piece...
Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment
Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments...
Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil>
Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments...
Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8)
Duration: 430.988753ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................] duration:
447.428541ms
FAIL (2025-07-08 05:46:31 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 8)
======LOGS======
pload=284991]: Uploading piece...
Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment
Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments...
Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil>
Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments...
Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8)
Duration: 447.458101ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [XXX.........................................................] duration:
448.41602ms
FAIL (2025-07-08 05:45:40 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 8)
======LOGS======
pload=284991]: Uploading piece...
Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment
Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments...
Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil>
Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments...
Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8)
Duration: 448.445841ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [.XXX........................................................] duration:
446.503228ms
FAIL (2025-07-08 05:44:29 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 8)
======LOGS======
pload=284991]: Uploading piece...
Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment
Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments...
Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil>
Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments...
Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8)
Duration: 446.534088ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [..XXX.......................................................] duration:
416.362095ms
FAIL (2025-07-08 05:43:39 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 8)
======LOGS======
pload=284991]: Uploading piece...
Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment
Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments...
Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil>
Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments...
Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8)
Duration: 416.395892ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [...XXX......................................................] duration:
472.143898ms
FAIL (2025-07-08 05:43:19 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 8)
======LOGS======
pload=284991]: Uploading piece...
Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment
Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments...
Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil>
Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments...
Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8)
Duration: 472.203818ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [....XXX.....................................................] duration:
451.670425ms
FAIL (2025-07-08 05:42:57 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 8)
======LOGS======
pload=284991]: Uploading piece...
Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment
Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments...
Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil>
Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments...
Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8)
Duration: 451.724843ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [.....XXX....................................................] duration:
453.335687ms
FAIL (2025-07-08 05:42:31 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 8)
======LOGS======
pload=284991]: Uploading piece...
Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment
Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments...
Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil>
Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments...
Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8)
Duration: 453.372892ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [......XXX...................................................] duration:
444.421321ms
FAIL (2025-07-08 05:41:35 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 8)
======LOGS======
pload=284991]: Uploading piece...
Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment
Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments...
Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil>
Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments...
Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8)
Duration: 444.788027ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
442.948007ms
FAIL (2025-07-08 05:41:34 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment
Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments...
Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil>
Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil>
Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil>
Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil>
Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil>
Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments...
Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 442.974166ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [.......XXX..................................................] duration:
452.619481ms
FAIL (2025-07-08 05:40:37 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 8)
======LOGS======
pload=284991]: Uploading piece...
Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment
Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments...
Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil>
Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments...
Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8)
Duration: 452.651268ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................] duration:
568.353506ms
FAIL (2025-07-08 05:40:30 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment
Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments...
Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil>
Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil>
Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil>
Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil>
Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil>
Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments...
Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 568.449839ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [XXX.........................................................] duration:
604.146288ms
FAIL (2025-07-08 05:40:08 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment
Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments...
Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil>
Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil>
Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil>
Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil>
Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil>
Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments...
Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 604.186327ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
3 out of 60 is failed (threshold=3) [........XXX.................................................] duration:
515.136115ms
FAIL (2025-07-08 05:39:55 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 8)
======LOGS======
pload=284991]: Uploading piece...
Jul 8 05:00:37.137063656 (355h49m4.063358349s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.137984339 (355h49m4.064279032s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138034396 (355h49m4.064329092s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138836689 (355h49m4.065131384s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.138884136 (355h49m4.065178829s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139428483 (355h49m4.065723178s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139436408 (355h49m4.0657311s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139788656 (355h49m4.066083348s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.139920627 (355h49m4.066215325s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140071882 (355h49m4.066366572s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140353654 (355h49m4.06664834s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140415319 (355h49m4.066710015s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140681286 (355h49m4.066975982s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.140973150 (355h49m4.067267847s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.144728804 (355h49m4.071023482s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Uploading piece...
Jul 8 05:00:37.249883590 (355h49m4.176178265s) [upload=284991]: Next returned nil segment
Jul 8 05:00:37.249902715 (355h49m4.176197412s) [upload=284991]: Waiting for error group managing segments...
Jul 8 05:00:37.260212837 (355h49m4.186507526s) [noise=true , address=104.36.82.21:4505 , piece_id=COWHHW42Y6SQ5MPFTYWBMFLRVG5IPODENUDMHVIP4C6ZCQ255AWA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.260803813 (355h49m4.187098502s) [noise=true , address=104.36.82.45:4915 , piece_id=G6IVO3DOQGN5GQKW67NX2ZKBOVTQEBA2PUNAGFDIKUI6OLPGMZHQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.260834568 (355h49m4.187129264s) [noise=true , address=104.36.82.37:4680 , piece_id=OJJ2PZASYAZOYLIKMPNIPU4X26NNOHVZTO3OGH2J2XASO2IVAIGA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261367510 (355h49m4.187662188s) [noise=true , address=104.36.82.19:4436 , piece_id=S2JCPQDCWXZGPDROJEKK5KL4ZS2HWY5GTPKH4EJMK5DJ6BDWGPNA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261455746 (355h49m4.187750422s) [noise=true , address=104.36.82.39:4754 , piece_id=KMKEARZDE7WLZAFNPB6MHKKVMAMSN4JCZWVU447JSTK63KODGTKQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.261903476 (355h49m4.188198155s) [noise=true , address=104.36.82.44:4881 , piece_id=GJQAUZWBAMKO3DJTFMES2AU5FL5J74VUGJ5O7DBMN3MFVDHA6FQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.278055422 (355h49m4.204350095s) [noise=true , address=104.36.82.60:4360 , piece_id=DBJIWOXACPT3GK66GZYTDT5PGN3WEGOD7UZUQW2K7JGTMYB3M23A, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:00:37.300910056 (355h49m4.227204736s) [noise=true , address=104.36.82.23:4464 , piece_id=JHDO2RBBZ2RIDLZ743E6X2MWOW3PQFEPOX2SSHEW3JDXPSXBYUDA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: <nil>
Jul 8 05:01:37.042774308 (355h50m3.969069003s) [noise=true , address=77.90.31.19:4855 , piece_id=46RSC2UCI5QVLZJEHAU5S245IGML6AMJRDATHCTPWF4242SRI5RQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:19LE2Lq4e6HojnMp9xQ3ySLkRe5PemXTwiQZThN5jT46bQhN6K, address:77.90.31.19:4855): protocol: rpc: dial tcp 77.90.31.19:4855: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.042887419 (355h50m3.969182106s) [noise=true , address=77.90.31.16:4747 , piece_id=HV6IOGCMOHIUEYTGJMQ62V4UUNJ2MQD37SFF5Y23X2S66YYQSN3Q, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12ERdBm3XPw4s7JHeMWsVniwcqnfMtP4ZX8sBVjri6dzZtq8AF2, address:77.90.31.16:4747): protocol: rpc: dial tcp 77.90.31.16:4747: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.042966233 (355h50m3.969260923s) [noise=true , address=77.90.31.19:4856 , piece_id=CR7AX6HZZGBQM5QATGLDLHQGUPZC4KW6H5CIBB4LFRTNL2WOLQFQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:1MntjJtcCDSRozKpesp6S2ZjYrMhxiQheDiPMPSCnavWBBGYt3, address:77.90.31.19:4856): protocol: rpc: dial tcp 77.90.31.19:4856: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043090813 (355h50m3.969385503s) [noise=true , address=77.90.31.14:4664 , piece_id=ESB7MNGQ7H6RD4P2IXUDWEZJARODYVQW3TC4NI64NMMGEEPBBFPA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12u52PWsW5g7XTky7sxS5mPFqpMD4AHCXFfera1WZyZF9xf6ma9, address:77.90.31.14:4664): protocol: write tcp 159.223.143.39:47434->77.90.31.14:4664: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043180860 (355h50m3.969475548s) [noise=true , address=77.90.31.11:4583 , piece_id=WX6UA42RKXN7SPI2RB4NXXY73PFK6LRLXVWIFAOKHLBYYITHDUCA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t, address:77.90.31.11:4583): protocol: write tcp 159.223.143.39:43298->77.90.31.11:4583: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043193162 (355h50m3.969487876s) [noise=true , address=77.90.31.18:4818 , piece_id=2GIDSTCP3A442OS44ZIG5KUMB7Y5B4337WAS32XLE5ZRNGU4Z4PQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12LuFBTJg1aNmZoEdiQTtvfnfh5qnWVZFtqFX93L4fNfiYTYqJ6, address:77.90.31.18:4818): protocol: rpc: dial tcp 77.90.31.18:4818: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043283221 (355h50m3.969577895s) [noise=true , address=77.90.31.12:4603 , piece_id=7MCDNMIXJVDLTTWA3TBEDYKDLSXCN36JNHK7SSBDFDGU6XDWXXBA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:126Sou5pnMm2eE2FJpv6WYX2VSqJvZZf9rFFJD6hFYDetRD28zu, address:77.90.31.12:4603): protocol: rpc: dial tcp 77.90.31.12:4603: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043307928 (355h50m3.969602654s) [noise=true , address=77.90.31.21:4895 , piece_id=RY6MY6WBPUAGBQYGW6NS4NKGKTNAF5NUGOBNAVGFNLJHYGCWPZMQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:12S7WBBQ1Nq8jbeGrZiRKTk23CdJC31hPW2vU1aaM5SsHeVyeRH, address:77.90.31.21:4895): protocol: rpc: dial tcp 77.90.31.21:4895: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043494443 (355h50m3.969789132s) [noise=true , address=77.90.31.17:4804 , piece_id=IUPYWS2X4ECV7LZ2M2WDMKONPVVD6T5SHUEX3747I4X7B54FPNRQ, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:168Tw7W69Tq9opDKhJ4cM8PGnzpxp9E9SxKbdVxJeF83pETqGx, address:77.90.31.17:4804): protocol: rpc: dial tcp 77.90.31.17:4804: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043560259 (355h50m3.969854956s) [noise=true , address=77.90.31.13:4632 , piece_id=5U23ECS42TH66KHWTI27WZE5ASUHGNRB2NFEVS6IOW44DY76DPQA, seg_pos={0 0}, upload=284991]: Done uploading piece. err: ecclient: upload failed (node:13iPed9zYrthvh36xo3k4gsqm4tz86iVkNvAr3wauuArQLquyS, address:77.90.31.13:4632): protocol: write tcp 159.223.143.39:37628->77.90.31.13:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:37.043598718 (355h50m3.969893411s) [seg_pos={0 0}, upload=284991]: Done waiting for segment. successful: 8 optimal: 14 errs: <nil>
Jul 8 05:01:37.086050110 (355h50m4.012344788s) [upload=284991]: Done uploading segments...
Jul 8 05:01:37.086091388 (355h50m4.012386065s) [upload=284991]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 8)
Duration: 515.204932ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [XXXX........................................................] duration:
428.893153ms
FAIL (2025-07-08 05:39:29 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 5)
======LOGS======
GPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.674108143 (355h49m20.600402838s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.674596780 (355h49m20.600891471s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.675604361 (355h49m20.601899058s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.675768580 (355h49m20.602063277s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.676120119 (355h49m20.60241481s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.676215473 (355h49m20.602510169s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.676623023 (355h49m20.602917716s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.676647235 (355h49m20.602941929s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.676696624 (355h49m20.602991321s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.677177615 (355h49m20.603472312s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.677707610 (355h49m20.604002306s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.678250080 (355h49m20.604544775s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.678907662 (355h49m20.605202358s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.679453605 (355h49m20.6057483s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.679618853 (355h49m20.605913551s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Uploading piece...
Jul 8 05:00:53.771112310 (355h49m20.697407s) [upload=284997]: Next returned nil segment
Jul 8 05:00:53.771144706 (355h49m20.697439396s) [upload=284997]: Waiting for error group managing segments...
Jul 8 05:00:53.780217385 (355h49m20.70651207s) [noise=true , address=104.36.82.16:4294 , piece_id=UMOOA2KAWCCQ2ADFRU5KMF5C2QKQSSG2BUBWFHHFYLN34D6ZTZNQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil>
Jul 8 05:00:53.780770161 (355h49m20.70706484s) [noise=true , address=104.36.82.14:4223 , piece_id=MN6ZYN6WRG24ZWUCWKHWKWJIIFIOTVCMD2LZRVZYN7YFJF2HHWVQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil>
Jul 8 05:00:53.781213801 (355h49m20.707508488s) [noise=true , address=104.36.82.7:4909 , piece_id=IVYHKYHXY6KIQZVLEAFOBUQDPMFQKWGXE5G7TMAP4DIOF2RWSFTQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil>
Jul 8 05:00:53.781712476 (355h49m20.708007155s) [noise=true , address=104.36.82.8:4972 , piece_id=SYE6RITGGKDRP2L3B5CG7TSOWAKW2IUHOOZMDCIDMW7BMRHN6T2A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil>
Jul 8 05:00:53.782192975 (355h49m20.708487647s) [noise=true , address=104.36.82.9:4005 , piece_id=OYXXEPKSZY76SYXGFJULBCHYBBUYBRZQNE35CHJWBSUPP3HYEKXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: <nil>
Jul 8 05:01:23.612230509 (355h49m50.538525197s) [noise=true , address=45.91.116.7:4010 , piece_id=MVNG6RHZXKDER3V25KSLORVSTUP2XOONSXLM6XHI33S4AYYLQAZA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w, address:45.91.116.7:4010): protocol: rpc: dial tcp 45.91.116.7:4010: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612301272 (355h49m50.538595951s) [noise=true , address=77.90.31.12:4589 , piece_id=LEZMVCMGJUZZ6EKTFLUU3HLBPWISRWRQROE755DMJSLAOFJMO7SA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 159.223.143.39:45850->77.90.31.12:4589: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612349516 (355h49m50.538644191s) [noise=true , address=45.91.116.4:4938 , piece_id=GTFP7GQZF7DSS4RGA5YMBAYH2RP2BZT2PZG7CMGD4C7IOJQNIICQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12M8xyCtkASb2kvUGac4p1RfGL9t623D81fse7we15eLFAH6rbW, address:45.91.116.4:4938): protocol: write tcp 159.223.143.39:38418->45.91.116.4:4938: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612454902 (355h49m50.538749592s) [noise=true , address=77.90.31.14:4662 , piece_id=OFALEXDRGT6DMUZ4T73HQTYKII7CJFYSBFYGCVEJDODZ5XXJUPXA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n, address:77.90.31.14:4662): protocol: rpc: dial tcp 77.90.31.14:4662: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612531645 (355h49m50.538826322s) [noise=true , address=45.91.116.12:4227 , piece_id=QEAVJTXOWMVH7JCF3BAPA7IKYGRDMCQUEPZM7UNQ5TLH577UUTXQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH, address:45.91.116.12:4227): protocol: write tcp 159.223.143.39:39432->45.91.116.12:4227: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612552075 (355h49m50.538846753s) [noise=true , address=45.91.116.11:4118 , piece_id=KFPPGPWOS7PDYBGT4QXOFZOJ5GDXDAAGR2VONXWZ4EDZXN4IZJDQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12ZDTj5nit2Gd5eVLYoeY8MeuMbvCHwAMKdzhVMx1j2QKTq3x7p, address:45.91.116.11:4118): protocol: write tcp 159.223.143.39:33394->45.91.116.11:4118: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612586657 (355h49m50.538881334s) [noise=true , address=45.91.116.9:4262 , piece_id=GMZSOJJJGC7Z5CKIXLQFKTKPSUT6ONGFKNG6LAU52O55RBL7GWKA, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12Rebnup7LaVo85uFG24Afr6oReVAc5NiAARKApQaP8soPczPto, address:45.91.116.9:4262): protocol: write tcp 159.223.143.39:49070->45.91.116.9:4262: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612604791 (355h49m50.538899468s) [noise=true , address=45.91.116.13:4153 , piece_id=IMG3DME7CFJM75LESTOLFWXCU3WNJUMNUUFRUKHFDREDYIN32XEQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1fSFcAat264kAGFqWt6Kkc14SSpUnXACWby84NqugHqheWcu2b, address:45.91.116.13:4153): protocol: rpc: dial tcp 45.91.116.13:4153: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612642895 (355h49m50.538937572s) [noise=true , address=45.91.116.14:4191 , piece_id=KQLOAIEJBPSCFGFKBV64B5UKC5TUDF22WXFKFPIC3KB7YHLBVY4A, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq, address:45.91.116.14:4191): protocol: rpc: dial tcp 45.91.116.14:4191: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612651542 (355h49m50.538946218s) [noise=true , address=77.90.31.17:4772 , piece_id=UIYNDDDBEDWKRRQNJF2IIDH2WUBW2AZOV2356NWXW7JIOX3B3SHQ, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE, address:77.90.31.17:4772): protocol: write tcp 159.223.143.39:47692->77.90.31.17:4772: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612680902 (355h49m50.538975589s) [noise=true , address=45.91.116.5:4299 , piece_id=Z2EMWRSBVV3NUQAAEJ3RKKSZA64LWM75YJQT24WJF4HCZF4XHG6Q, seg_pos={0 0}, upload=284997]: Done uploading piece. err: ecclient: upload failed (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX, address:45.91.116.5:4299): protocol: rpc: dial tcp 45.91.116.5:4299: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 8 05:01:23.612713168 (355h49m50.539007856s) [seg_pos={0 0}, upload=284997]: Done waiting for segment. successful: 5 optimal: 13 errs: <nil>
Jul 8 05:01:23.648975097 (355h49m50.575269777s) [upload=284997]: Done uploading segments...
Jul 8 05:01:23.649010451 (355h49m50.575305138s) [upload=284997]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 5)
Duration: 428.919715ms
core
uplink
us-select-1
|