Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 687.370257ms FAIL (2025-06-30 11:09:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 687.393544ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 734.347641ms FAIL (2025-06-30 11:08:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 734.376178ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 907.508519ms FAIL (2025-06-30 11:07:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 907.536711ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 337.22004ms FAIL (2025-06-30 11:06:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 337.251521ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 338.329894ms FAIL (2025-06-30 11:06:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 338.36659ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 266.584883ms FAIL (2025-06-30 11:05:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 266.620789ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 278.394987ms FAIL (2025-06-30 11:04:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 278.429467ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 291.25681ms FAIL (2025-06-30 11:04:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 291.285288ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 269.691373ms FAIL (2025-06-30 11:03:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 269.718343ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 277.28825ms FAIL (2025-06-30 11:03:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 277.365206ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 284.806957ms FAIL (2025-06-30 11:02:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 284.832746ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 434.116384ms FAIL (2025-06-30 11:02:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 434.16759ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 278.765001ms FAIL (2025-06-30 11:01:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 278.815016ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 763.240716ms FAIL (2025-06-30 11:00:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 763.269896ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 290.229827ms FAIL (2025-06-30 10:59:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 290.254923ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 265.904462ms FAIL (2025-06-30 10:59:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 265.928588ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 262.480499ms FAIL (2025-06-30 10:58:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 262.504162ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 292.90476ms FAIL (2025-06-30 10:57:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 292.930528ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 746.119514ms FAIL (2025-06-30 10:56:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 746.143096ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 601.320627ms FAIL (2025-06-30 10:55:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 601.345247ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 261.715163ms FAIL (2025-06-30 10:55:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 261.802331ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 261.043183ms FAIL (2025-06-30 10:54:09 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 261.070525ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 315.185368ms FAIL (2025-06-30 10:53:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 315.286395ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 287.294343ms FAIL (2025-06-30 10:52:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 287.319234ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 271.967404ms FAIL (2025-06-30 10:52:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 271.991406ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 247.130571ms FAIL (2025-06-30 10:51:29 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 247.157101ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 285.478849ms FAIL (2025-06-30 10:50:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 285.500198ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 297.621733ms FAIL (2025-06-30 10:49:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 297.65733ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 302.399679ms FAIL (2025-06-30 10:49:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 302.423807ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 493.652687ms FAIL (2025-06-30 08:45:52 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== bjectBegin Jun 30 08:02:09.521526833 (166h50m36.447821528s) [upload=133682]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 30 08:02:10.707674536 (166h50m37.633969233s) [seg_pos={0 0}, upload=133682]: Begin upload segment... Jun 30 08:02:10.707741540 (166h50m37.634036235s) [seg_pos={0 0}, upload=133682]: Done begin upload segment. Jun 30 08:02:10.707765938 (166h50m37.634060615s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707787500 (166h50m37.634082202s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707865104 (166h50m37.634159798s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708236369 (166h50m37.634531062s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708243540 (166h50m37.634538238s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708574357 (166h50m37.634869047s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708620817 (166h50m37.634915512s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708903894 (166h50m37.635198583s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708942260 (166h50m37.635236952s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709222534 (166h50m37.635517333s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709268432 (166h50m37.635563124s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709620733 (166h50m37.635915425s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709912660 (166h50m37.636207352s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710245117 (166h50m37.636539803s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710532064 (166h50m37.636826754s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710854515 (166h50m37.637149206s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711081096 (166h50m37.637375791s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711231002 (166h50m37.637525691s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.785256160 (166h50m37.711550846s) [upload=133682]: Next returned nil segment Jun 30 08:02:10.785270524 (166h50m37.71156521s) [upload=133682]: Waiting for error group managing segments... Jun 30 08:02:10.788413774 (166h50m37.714708454s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.789506554 (166h50m37.715801233s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.791101128 (166h50m37.717395806s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.792464349 (166h50m37.718759029s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793560375 (166h50m37.719855062s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793674978 (166h50m37.719969657s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.805707431 (166h50m37.732002111s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.808620050 (166h50m37.734914727s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.812691662 (166h50m37.738986335s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.817015454 (166h50m37.743310142s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.826452214 (166h50m37.752746893s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.830751774 (166h50m37.757046455s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.837694268 (166h50m37.763988946s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.910774346 (166h50m37.83706904s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1dReW9bUadCFKYw28ico3Wh4v97rJmffX9ZhS3eCCRMCG9qX6h, address:79.127.201.214:4301): protocol: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection Jun 30 08:02:10.911096576 (166h50m37.837391271s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf, address:79.127.201.214:4298): protocol: expected piece hash; context deadline exceeded; EOF Jun 30 08:02:10.911315947 (166h50m37.837610638s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk, address:64.49.13.140:4511): protocol: read tcp 159.223.143.39:42620->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911347308 (166h50m37.837642004s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9, address:64.49.13.137:4500): protocol: read tcp 159.223.143.39:54982->64.49.13.137:4500: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911385931 (166h50m37.837680618s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12NR52pweTqZNNMTyc1EHSbifDKB4awrnnb4megtZHwANSrR18T, address:79.127.205.233:4645): protocol: read tcp 159.223.143.39:57052->79.127.205.233:4645: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911435829 (166h50m37.837730525s) [seg_pos={0 0}, upload=133682]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 30 08:02:10.983099615 (166h50m37.909394303s) [upload=133682]: Done uploading segments... Jun 30 08:02:10.983130346 (166h50m37.909425039s) [upload=133682]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 493.76741ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 611.008673ms FAIL (2025-06-30 08:44:43 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== bjectBegin Jun 30 08:02:09.521526833 (166h50m36.447821528s) [upload=133682]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 30 08:02:10.707674536 (166h50m37.633969233s) [seg_pos={0 0}, upload=133682]: Begin upload segment... Jun 30 08:02:10.707741540 (166h50m37.634036235s) [seg_pos={0 0}, upload=133682]: Done begin upload segment. Jun 30 08:02:10.707765938 (166h50m37.634060615s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707787500 (166h50m37.634082202s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707865104 (166h50m37.634159798s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708236369 (166h50m37.634531062s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708243540 (166h50m37.634538238s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708574357 (166h50m37.634869047s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708620817 (166h50m37.634915512s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708903894 (166h50m37.635198583s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708942260 (166h50m37.635236952s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709222534 (166h50m37.635517333s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709268432 (166h50m37.635563124s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709620733 (166h50m37.635915425s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709912660 (166h50m37.636207352s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710245117 (166h50m37.636539803s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710532064 (166h50m37.636826754s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710854515 (166h50m37.637149206s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711081096 (166h50m37.637375791s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711231002 (166h50m37.637525691s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.785256160 (166h50m37.711550846s) [upload=133682]: Next returned nil segment Jun 30 08:02:10.785270524 (166h50m37.71156521s) [upload=133682]: Waiting for error group managing segments... Jun 30 08:02:10.788413774 (166h50m37.714708454s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.789506554 (166h50m37.715801233s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.791101128 (166h50m37.717395806s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.792464349 (166h50m37.718759029s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793560375 (166h50m37.719855062s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793674978 (166h50m37.719969657s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.805707431 (166h50m37.732002111s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.808620050 (166h50m37.734914727s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.812691662 (166h50m37.738986335s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.817015454 (166h50m37.743310142s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.826452214 (166h50m37.752746893s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.830751774 (166h50m37.757046455s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.837694268 (166h50m37.763988946s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.910774346 (166h50m37.83706904s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1dReW9bUadCFKYw28ico3Wh4v97rJmffX9ZhS3eCCRMCG9qX6h, address:79.127.201.214:4301): protocol: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection Jun 30 08:02:10.911096576 (166h50m37.837391271s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf, address:79.127.201.214:4298): protocol: expected piece hash; context deadline exceeded; EOF Jun 30 08:02:10.911315947 (166h50m37.837610638s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk, address:64.49.13.140:4511): protocol: read tcp 159.223.143.39:42620->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911347308 (166h50m37.837642004s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9, address:64.49.13.137:4500): protocol: read tcp 159.223.143.39:54982->64.49.13.137:4500: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911385931 (166h50m37.837680618s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12NR52pweTqZNNMTyc1EHSbifDKB4awrnnb4megtZHwANSrR18T, address:79.127.205.233:4645): protocol: read tcp 159.223.143.39:57052->79.127.205.233:4645: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911435829 (166h50m37.837730525s) [seg_pos={0 0}, upload=133682]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 30 08:02:10.983099615 (166h50m37.909394303s) [upload=133682]: Done uploading segments... Jun 30 08:02:10.983130346 (166h50m37.909425039s) [upload=133682]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 611.052878ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 517.419083ms FAIL (2025-06-30 08:44:01 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== bjectBegin Jun 30 08:02:09.521526833 (166h50m36.447821528s) [upload=133682]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 30 08:02:10.707674536 (166h50m37.633969233s) [seg_pos={0 0}, upload=133682]: Begin upload segment... Jun 30 08:02:10.707741540 (166h50m37.634036235s) [seg_pos={0 0}, upload=133682]: Done begin upload segment. Jun 30 08:02:10.707765938 (166h50m37.634060615s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707787500 (166h50m37.634082202s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707865104 (166h50m37.634159798s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708236369 (166h50m37.634531062s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708243540 (166h50m37.634538238s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708574357 (166h50m37.634869047s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708620817 (166h50m37.634915512s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708903894 (166h50m37.635198583s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708942260 (166h50m37.635236952s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709222534 (166h50m37.635517333s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709268432 (166h50m37.635563124s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709620733 (166h50m37.635915425s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709912660 (166h50m37.636207352s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710245117 (166h50m37.636539803s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710532064 (166h50m37.636826754s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710854515 (166h50m37.637149206s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711081096 (166h50m37.637375791s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711231002 (166h50m37.637525691s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.785256160 (166h50m37.711550846s) [upload=133682]: Next returned nil segment Jun 30 08:02:10.785270524 (166h50m37.71156521s) [upload=133682]: Waiting for error group managing segments... Jun 30 08:02:10.788413774 (166h50m37.714708454s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.789506554 (166h50m37.715801233s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.791101128 (166h50m37.717395806s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.792464349 (166h50m37.718759029s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793560375 (166h50m37.719855062s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793674978 (166h50m37.719969657s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.805707431 (166h50m37.732002111s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.808620050 (166h50m37.734914727s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.812691662 (166h50m37.738986335s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.817015454 (166h50m37.743310142s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.826452214 (166h50m37.752746893s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.830751774 (166h50m37.757046455s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.837694268 (166h50m37.763988946s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.910774346 (166h50m37.83706904s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1dReW9bUadCFKYw28ico3Wh4v97rJmffX9ZhS3eCCRMCG9qX6h, address:79.127.201.214:4301): protocol: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection Jun 30 08:02:10.911096576 (166h50m37.837391271s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf, address:79.127.201.214:4298): protocol: expected piece hash; context deadline exceeded; EOF Jun 30 08:02:10.911315947 (166h50m37.837610638s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk, address:64.49.13.140:4511): protocol: read tcp 159.223.143.39:42620->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911347308 (166h50m37.837642004s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9, address:64.49.13.137:4500): protocol: read tcp 159.223.143.39:54982->64.49.13.137:4500: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911385931 (166h50m37.837680618s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12NR52pweTqZNNMTyc1EHSbifDKB4awrnnb4megtZHwANSrR18T, address:79.127.205.233:4645): protocol: read tcp 159.223.143.39:57052->79.127.205.233:4645: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911435829 (166h50m37.837730525s) [seg_pos={0 0}, upload=133682]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 30 08:02:10.983099615 (166h50m37.909394303s) [upload=133682]: Done uploading segments... Jun 30 08:02:10.983130346 (166h50m37.909425039s) [upload=133682]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 517.445592ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 497.501404ms FAIL (2025-06-30 08:43:19 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== bjectBegin Jun 30 08:02:09.521526833 (166h50m36.447821528s) [upload=133682]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 30 08:02:10.707674536 (166h50m37.633969233s) [seg_pos={0 0}, upload=133682]: Begin upload segment... Jun 30 08:02:10.707741540 (166h50m37.634036235s) [seg_pos={0 0}, upload=133682]: Done begin upload segment. Jun 30 08:02:10.707765938 (166h50m37.634060615s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707787500 (166h50m37.634082202s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707865104 (166h50m37.634159798s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708236369 (166h50m37.634531062s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708243540 (166h50m37.634538238s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708574357 (166h50m37.634869047s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708620817 (166h50m37.634915512s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708903894 (166h50m37.635198583s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708942260 (166h50m37.635236952s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709222534 (166h50m37.635517333s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709268432 (166h50m37.635563124s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709620733 (166h50m37.635915425s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709912660 (166h50m37.636207352s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710245117 (166h50m37.636539803s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710532064 (166h50m37.636826754s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710854515 (166h50m37.637149206s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711081096 (166h50m37.637375791s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711231002 (166h50m37.637525691s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.785256160 (166h50m37.711550846s) [upload=133682]: Next returned nil segment Jun 30 08:02:10.785270524 (166h50m37.71156521s) [upload=133682]: Waiting for error group managing segments... Jun 30 08:02:10.788413774 (166h50m37.714708454s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.789506554 (166h50m37.715801233s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.791101128 (166h50m37.717395806s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.792464349 (166h50m37.718759029s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793560375 (166h50m37.719855062s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793674978 (166h50m37.719969657s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.805707431 (166h50m37.732002111s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.808620050 (166h50m37.734914727s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.812691662 (166h50m37.738986335s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.817015454 (166h50m37.743310142s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.826452214 (166h50m37.752746893s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.830751774 (166h50m37.757046455s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.837694268 (166h50m37.763988946s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.910774346 (166h50m37.83706904s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1dReW9bUadCFKYw28ico3Wh4v97rJmffX9ZhS3eCCRMCG9qX6h, address:79.127.201.214:4301): protocol: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection Jun 30 08:02:10.911096576 (166h50m37.837391271s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf, address:79.127.201.214:4298): protocol: expected piece hash; context deadline exceeded; EOF Jun 30 08:02:10.911315947 (166h50m37.837610638s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk, address:64.49.13.140:4511): protocol: read tcp 159.223.143.39:42620->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911347308 (166h50m37.837642004s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9, address:64.49.13.137:4500): protocol: read tcp 159.223.143.39:54982->64.49.13.137:4500: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911385931 (166h50m37.837680618s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12NR52pweTqZNNMTyc1EHSbifDKB4awrnnb4megtZHwANSrR18T, address:79.127.205.233:4645): protocol: read tcp 159.223.143.39:57052->79.127.205.233:4645: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911435829 (166h50m37.837730525s) [seg_pos={0 0}, upload=133682]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 30 08:02:10.983099615 (166h50m37.909394303s) [upload=133682]: Done uploading segments... Jun 30 08:02:10.983130346 (166h50m37.909425039s) [upload=133682]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 497.60936ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 705.677442ms FAIL (2025-06-30 08:42:43 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== bjectBegin Jun 30 08:02:09.521526833 (166h50m36.447821528s) [upload=133682]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 30 08:02:10.707674536 (166h50m37.633969233s) [seg_pos={0 0}, upload=133682]: Begin upload segment... Jun 30 08:02:10.707741540 (166h50m37.634036235s) [seg_pos={0 0}, upload=133682]: Done begin upload segment. Jun 30 08:02:10.707765938 (166h50m37.634060615s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707787500 (166h50m37.634082202s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707865104 (166h50m37.634159798s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708236369 (166h50m37.634531062s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708243540 (166h50m37.634538238s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708574357 (166h50m37.634869047s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708620817 (166h50m37.634915512s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708903894 (166h50m37.635198583s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708942260 (166h50m37.635236952s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709222534 (166h50m37.635517333s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709268432 (166h50m37.635563124s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709620733 (166h50m37.635915425s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709912660 (166h50m37.636207352s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710245117 (166h50m37.636539803s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710532064 (166h50m37.636826754s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710854515 (166h50m37.637149206s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711081096 (166h50m37.637375791s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711231002 (166h50m37.637525691s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.785256160 (166h50m37.711550846s) [upload=133682]: Next returned nil segment Jun 30 08:02:10.785270524 (166h50m37.71156521s) [upload=133682]: Waiting for error group managing segments... Jun 30 08:02:10.788413774 (166h50m37.714708454s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.789506554 (166h50m37.715801233s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.791101128 (166h50m37.717395806s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.792464349 (166h50m37.718759029s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793560375 (166h50m37.719855062s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793674978 (166h50m37.719969657s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.805707431 (166h50m37.732002111s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.808620050 (166h50m37.734914727s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.812691662 (166h50m37.738986335s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.817015454 (166h50m37.743310142s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.826452214 (166h50m37.752746893s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.830751774 (166h50m37.757046455s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.837694268 (166h50m37.763988946s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.910774346 (166h50m37.83706904s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1dReW9bUadCFKYw28ico3Wh4v97rJmffX9ZhS3eCCRMCG9qX6h, address:79.127.201.214:4301): protocol: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection Jun 30 08:02:10.911096576 (166h50m37.837391271s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf, address:79.127.201.214:4298): protocol: expected piece hash; context deadline exceeded; EOF Jun 30 08:02:10.911315947 (166h50m37.837610638s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk, address:64.49.13.140:4511): protocol: read tcp 159.223.143.39:42620->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911347308 (166h50m37.837642004s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9, address:64.49.13.137:4500): protocol: read tcp 159.223.143.39:54982->64.49.13.137:4500: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911385931 (166h50m37.837680618s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12NR52pweTqZNNMTyc1EHSbifDKB4awrnnb4megtZHwANSrR18T, address:79.127.205.233:4645): protocol: read tcp 159.223.143.39:57052->79.127.205.233:4645: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911435829 (166h50m37.837730525s) [seg_pos={0 0}, upload=133682]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 30 08:02:10.983099615 (166h50m37.909394303s) [upload=133682]: Done uploading segments... Jun 30 08:02:10.983130346 (166h50m37.909425039s) [upload=133682]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 705.695939ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 475.414632ms FAIL (2025-06-30 08:42:06 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== bjectBegin Jun 30 08:02:09.521526833 (166h50m36.447821528s) [upload=133682]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 30 08:02:10.707674536 (166h50m37.633969233s) [seg_pos={0 0}, upload=133682]: Begin upload segment... Jun 30 08:02:10.707741540 (166h50m37.634036235s) [seg_pos={0 0}, upload=133682]: Done begin upload segment. Jun 30 08:02:10.707765938 (166h50m37.634060615s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707787500 (166h50m37.634082202s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707865104 (166h50m37.634159798s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708236369 (166h50m37.634531062s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708243540 (166h50m37.634538238s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708574357 (166h50m37.634869047s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708620817 (166h50m37.634915512s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708903894 (166h50m37.635198583s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708942260 (166h50m37.635236952s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709222534 (166h50m37.635517333s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709268432 (166h50m37.635563124s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709620733 (166h50m37.635915425s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709912660 (166h50m37.636207352s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710245117 (166h50m37.636539803s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710532064 (166h50m37.636826754s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710854515 (166h50m37.637149206s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711081096 (166h50m37.637375791s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711231002 (166h50m37.637525691s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.785256160 (166h50m37.711550846s) [upload=133682]: Next returned nil segment Jun 30 08:02:10.785270524 (166h50m37.71156521s) [upload=133682]: Waiting for error group managing segments... Jun 30 08:02:10.788413774 (166h50m37.714708454s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.789506554 (166h50m37.715801233s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.791101128 (166h50m37.717395806s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.792464349 (166h50m37.718759029s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793560375 (166h50m37.719855062s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793674978 (166h50m37.719969657s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.805707431 (166h50m37.732002111s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.808620050 (166h50m37.734914727s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.812691662 (166h50m37.738986335s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.817015454 (166h50m37.743310142s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.826452214 (166h50m37.752746893s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.830751774 (166h50m37.757046455s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.837694268 (166h50m37.763988946s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.910774346 (166h50m37.83706904s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1dReW9bUadCFKYw28ico3Wh4v97rJmffX9ZhS3eCCRMCG9qX6h, address:79.127.201.214:4301): protocol: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection Jun 30 08:02:10.911096576 (166h50m37.837391271s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf, address:79.127.201.214:4298): protocol: expected piece hash; context deadline exceeded; EOF Jun 30 08:02:10.911315947 (166h50m37.837610638s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk, address:64.49.13.140:4511): protocol: read tcp 159.223.143.39:42620->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911347308 (166h50m37.837642004s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9, address:64.49.13.137:4500): protocol: read tcp 159.223.143.39:54982->64.49.13.137:4500: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911385931 (166h50m37.837680618s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12NR52pweTqZNNMTyc1EHSbifDKB4awrnnb4megtZHwANSrR18T, address:79.127.205.233:4645): protocol: read tcp 159.223.143.39:57052->79.127.205.233:4645: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911435829 (166h50m37.837730525s) [seg_pos={0 0}, upload=133682]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 30 08:02:10.983099615 (166h50m37.909394303s) [upload=133682]: Done uploading segments... Jun 30 08:02:10.983130346 (166h50m37.909425039s) [upload=133682]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 475.441898ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 502.912141ms FAIL (2025-06-30 08:41:20 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== bjectBegin Jun 30 08:02:09.521526833 (166h50m36.447821528s) [upload=133682]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 30 08:02:10.707674536 (166h50m37.633969233s) [seg_pos={0 0}, upload=133682]: Begin upload segment... Jun 30 08:02:10.707741540 (166h50m37.634036235s) [seg_pos={0 0}, upload=133682]: Done begin upload segment. Jun 30 08:02:10.707765938 (166h50m37.634060615s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707787500 (166h50m37.634082202s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707865104 (166h50m37.634159798s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708236369 (166h50m37.634531062s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708243540 (166h50m37.634538238s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708574357 (166h50m37.634869047s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708620817 (166h50m37.634915512s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708903894 (166h50m37.635198583s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708942260 (166h50m37.635236952s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709222534 (166h50m37.635517333s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709268432 (166h50m37.635563124s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709620733 (166h50m37.635915425s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709912660 (166h50m37.636207352s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710245117 (166h50m37.636539803s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710532064 (166h50m37.636826754s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710854515 (166h50m37.637149206s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711081096 (166h50m37.637375791s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711231002 (166h50m37.637525691s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.785256160 (166h50m37.711550846s) [upload=133682]: Next returned nil segment Jun 30 08:02:10.785270524 (166h50m37.71156521s) [upload=133682]: Waiting for error group managing segments... Jun 30 08:02:10.788413774 (166h50m37.714708454s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.789506554 (166h50m37.715801233s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.791101128 (166h50m37.717395806s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.792464349 (166h50m37.718759029s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793560375 (166h50m37.719855062s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793674978 (166h50m37.719969657s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.805707431 (166h50m37.732002111s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.808620050 (166h50m37.734914727s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.812691662 (166h50m37.738986335s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.817015454 (166h50m37.743310142s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.826452214 (166h50m37.752746893s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.830751774 (166h50m37.757046455s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.837694268 (166h50m37.763988946s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.910774346 (166h50m37.83706904s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1dReW9bUadCFKYw28ico3Wh4v97rJmffX9ZhS3eCCRMCG9qX6h, address:79.127.201.214:4301): protocol: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection Jun 30 08:02:10.911096576 (166h50m37.837391271s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf, address:79.127.201.214:4298): protocol: expected piece hash; context deadline exceeded; EOF Jun 30 08:02:10.911315947 (166h50m37.837610638s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk, address:64.49.13.140:4511): protocol: read tcp 159.223.143.39:42620->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911347308 (166h50m37.837642004s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9, address:64.49.13.137:4500): protocol: read tcp 159.223.143.39:54982->64.49.13.137:4500: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911385931 (166h50m37.837680618s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12NR52pweTqZNNMTyc1EHSbifDKB4awrnnb4megtZHwANSrR18T, address:79.127.205.233:4645): protocol: read tcp 159.223.143.39:57052->79.127.205.233:4645: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911435829 (166h50m37.837730525s) [seg_pos={0 0}, upload=133682]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 30 08:02:10.983099615 (166h50m37.909394303s) [upload=133682]: Done uploading segments... Jun 30 08:02:10.983130346 (166h50m37.909425039s) [upload=133682]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 502.936467ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 647.432499ms FAIL (2025-06-30 08:41:02 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== bjectBegin Jun 30 08:02:09.521526833 (166h50m36.447821528s) [upload=133682]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 30 08:02:10.707674536 (166h50m37.633969233s) [seg_pos={0 0}, upload=133682]: Begin upload segment... Jun 30 08:02:10.707741540 (166h50m37.634036235s) [seg_pos={0 0}, upload=133682]: Done begin upload segment. Jun 30 08:02:10.707765938 (166h50m37.634060615s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707787500 (166h50m37.634082202s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707865104 (166h50m37.634159798s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708236369 (166h50m37.634531062s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708243540 (166h50m37.634538238s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708574357 (166h50m37.634869047s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708620817 (166h50m37.634915512s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708903894 (166h50m37.635198583s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708942260 (166h50m37.635236952s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709222534 (166h50m37.635517333s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709268432 (166h50m37.635563124s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709620733 (166h50m37.635915425s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709912660 (166h50m37.636207352s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710245117 (166h50m37.636539803s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710532064 (166h50m37.636826754s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710854515 (166h50m37.637149206s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711081096 (166h50m37.637375791s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711231002 (166h50m37.637525691s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.785256160 (166h50m37.711550846s) [upload=133682]: Next returned nil segment Jun 30 08:02:10.785270524 (166h50m37.71156521s) [upload=133682]: Waiting for error group managing segments... Jun 30 08:02:10.788413774 (166h50m37.714708454s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.789506554 (166h50m37.715801233s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.791101128 (166h50m37.717395806s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.792464349 (166h50m37.718759029s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793560375 (166h50m37.719855062s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793674978 (166h50m37.719969657s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.805707431 (166h50m37.732002111s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.808620050 (166h50m37.734914727s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.812691662 (166h50m37.738986335s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.817015454 (166h50m37.743310142s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.826452214 (166h50m37.752746893s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.830751774 (166h50m37.757046455s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.837694268 (166h50m37.763988946s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.910774346 (166h50m37.83706904s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1dReW9bUadCFKYw28ico3Wh4v97rJmffX9ZhS3eCCRMCG9qX6h, address:79.127.201.214:4301): protocol: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection Jun 30 08:02:10.911096576 (166h50m37.837391271s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf, address:79.127.201.214:4298): protocol: expected piece hash; context deadline exceeded; EOF Jun 30 08:02:10.911315947 (166h50m37.837610638s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk, address:64.49.13.140:4511): protocol: read tcp 159.223.143.39:42620->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911347308 (166h50m37.837642004s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9, address:64.49.13.137:4500): protocol: read tcp 159.223.143.39:54982->64.49.13.137:4500: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911385931 (166h50m37.837680618s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12NR52pweTqZNNMTyc1EHSbifDKB4awrnnb4megtZHwANSrR18T, address:79.127.205.233:4645): protocol: read tcp 159.223.143.39:57052->79.127.205.233:4645: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911435829 (166h50m37.837730525s) [seg_pos={0 0}, upload=133682]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 30 08:02:10.983099615 (166h50m37.909394303s) [upload=133682]: Done uploading segments... Jun 30 08:02:10.983130346 (166h50m37.909425039s) [upload=133682]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 647.462491ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 631.771612ms FAIL (2025-06-30 08:40:06 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== bjectBegin Jun 30 08:02:09.521526833 (166h50m36.447821528s) [upload=133682]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 30 08:02:10.707674536 (166h50m37.633969233s) [seg_pos={0 0}, upload=133682]: Begin upload segment... Jun 30 08:02:10.707741540 (166h50m37.634036235s) [seg_pos={0 0}, upload=133682]: Done begin upload segment. Jun 30 08:02:10.707765938 (166h50m37.634060615s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707787500 (166h50m37.634082202s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707865104 (166h50m37.634159798s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708236369 (166h50m37.634531062s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708243540 (166h50m37.634538238s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708574357 (166h50m37.634869047s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708620817 (166h50m37.634915512s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708903894 (166h50m37.635198583s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708942260 (166h50m37.635236952s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709222534 (166h50m37.635517333s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709268432 (166h50m37.635563124s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709620733 (166h50m37.635915425s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709912660 (166h50m37.636207352s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710245117 (166h50m37.636539803s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710532064 (166h50m37.636826754s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710854515 (166h50m37.637149206s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711081096 (166h50m37.637375791s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711231002 (166h50m37.637525691s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.785256160 (166h50m37.711550846s) [upload=133682]: Next returned nil segment Jun 30 08:02:10.785270524 (166h50m37.71156521s) [upload=133682]: Waiting for error group managing segments... Jun 30 08:02:10.788413774 (166h50m37.714708454s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.789506554 (166h50m37.715801233s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.791101128 (166h50m37.717395806s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.792464349 (166h50m37.718759029s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793560375 (166h50m37.719855062s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793674978 (166h50m37.719969657s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.805707431 (166h50m37.732002111s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.808620050 (166h50m37.734914727s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.812691662 (166h50m37.738986335s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.817015454 (166h50m37.743310142s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.826452214 (166h50m37.752746893s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.830751774 (166h50m37.757046455s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.837694268 (166h50m37.763988946s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.910774346 (166h50m37.83706904s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1dReW9bUadCFKYw28ico3Wh4v97rJmffX9ZhS3eCCRMCG9qX6h, address:79.127.201.214:4301): protocol: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection Jun 30 08:02:10.911096576 (166h50m37.837391271s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf, address:79.127.201.214:4298): protocol: expected piece hash; context deadline exceeded; EOF Jun 30 08:02:10.911315947 (166h50m37.837610638s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk, address:64.49.13.140:4511): protocol: read tcp 159.223.143.39:42620->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911347308 (166h50m37.837642004s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9, address:64.49.13.137:4500): protocol: read tcp 159.223.143.39:54982->64.49.13.137:4500: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911385931 (166h50m37.837680618s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12NR52pweTqZNNMTyc1EHSbifDKB4awrnnb4megtZHwANSrR18T, address:79.127.205.233:4645): protocol: read tcp 159.223.143.39:57052->79.127.205.233:4645: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911435829 (166h50m37.837730525s) [seg_pos={0 0}, upload=133682]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 30 08:02:10.983099615 (166h50m37.909394303s) [upload=133682]: Done uploading segments... Jun 30 08:02:10.983130346 (166h50m37.909425039s) [upload=133682]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 631.903844ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 643.481813ms FAIL (2025-06-30 08:39:22 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== bjectBegin Jun 30 08:02:09.521526833 (166h50m36.447821528s) [upload=133682]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 30 08:02:10.707674536 (166h50m37.633969233s) [seg_pos={0 0}, upload=133682]: Begin upload segment... Jun 30 08:02:10.707741540 (166h50m37.634036235s) [seg_pos={0 0}, upload=133682]: Done begin upload segment. Jun 30 08:02:10.707765938 (166h50m37.634060615s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707787500 (166h50m37.634082202s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707865104 (166h50m37.634159798s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708236369 (166h50m37.634531062s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708243540 (166h50m37.634538238s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708574357 (166h50m37.634869047s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708620817 (166h50m37.634915512s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708903894 (166h50m37.635198583s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708942260 (166h50m37.635236952s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709222534 (166h50m37.635517333s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709268432 (166h50m37.635563124s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709620733 (166h50m37.635915425s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709912660 (166h50m37.636207352s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710245117 (166h50m37.636539803s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710532064 (166h50m37.636826754s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710854515 (166h50m37.637149206s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711081096 (166h50m37.637375791s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711231002 (166h50m37.637525691s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.785256160 (166h50m37.711550846s) [upload=133682]: Next returned nil segment Jun 30 08:02:10.785270524 (166h50m37.71156521s) [upload=133682]: Waiting for error group managing segments... Jun 30 08:02:10.788413774 (166h50m37.714708454s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.789506554 (166h50m37.715801233s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.791101128 (166h50m37.717395806s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.792464349 (166h50m37.718759029s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793560375 (166h50m37.719855062s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793674978 (166h50m37.719969657s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.805707431 (166h50m37.732002111s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.808620050 (166h50m37.734914727s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.812691662 (166h50m37.738986335s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.817015454 (166h50m37.743310142s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.826452214 (166h50m37.752746893s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.830751774 (166h50m37.757046455s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.837694268 (166h50m37.763988946s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.910774346 (166h50m37.83706904s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1dReW9bUadCFKYw28ico3Wh4v97rJmffX9ZhS3eCCRMCG9qX6h, address:79.127.201.214:4301): protocol: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection Jun 30 08:02:10.911096576 (166h50m37.837391271s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf, address:79.127.201.214:4298): protocol: expected piece hash; context deadline exceeded; EOF Jun 30 08:02:10.911315947 (166h50m37.837610638s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk, address:64.49.13.140:4511): protocol: read tcp 159.223.143.39:42620->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911347308 (166h50m37.837642004s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9, address:64.49.13.137:4500): protocol: read tcp 159.223.143.39:54982->64.49.13.137:4500: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911385931 (166h50m37.837680618s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12NR52pweTqZNNMTyc1EHSbifDKB4awrnnb4megtZHwANSrR18T, address:79.127.205.233:4645): protocol: read tcp 159.223.143.39:57052->79.127.205.233:4645: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911435829 (166h50m37.837730525s) [seg_pos={0 0}, upload=133682]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 30 08:02:10.983099615 (166h50m37.909394303s) [upload=133682]: Done uploading segments... Jun 30 08:02:10.983130346 (166h50m37.909425039s) [upload=133682]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 643.532723ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 947.71625ms FAIL (2025-06-30 08:38:43 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== bjectBegin Jun 30 08:02:09.521526833 (166h50m36.447821528s) [upload=133682]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 30 08:02:10.707674536 (166h50m37.633969233s) [seg_pos={0 0}, upload=133682]: Begin upload segment... Jun 30 08:02:10.707741540 (166h50m37.634036235s) [seg_pos={0 0}, upload=133682]: Done begin upload segment. Jun 30 08:02:10.707765938 (166h50m37.634060615s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707787500 (166h50m37.634082202s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707865104 (166h50m37.634159798s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708236369 (166h50m37.634531062s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708243540 (166h50m37.634538238s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708574357 (166h50m37.634869047s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708620817 (166h50m37.634915512s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708903894 (166h50m37.635198583s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708942260 (166h50m37.635236952s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709222534 (166h50m37.635517333s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709268432 (166h50m37.635563124s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709620733 (166h50m37.635915425s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709912660 (166h50m37.636207352s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710245117 (166h50m37.636539803s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710532064 (166h50m37.636826754s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710854515 (166h50m37.637149206s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711081096 (166h50m37.637375791s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711231002 (166h50m37.637525691s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.785256160 (166h50m37.711550846s) [upload=133682]: Next returned nil segment Jun 30 08:02:10.785270524 (166h50m37.71156521s) [upload=133682]: Waiting for error group managing segments... Jun 30 08:02:10.788413774 (166h50m37.714708454s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.789506554 (166h50m37.715801233s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.791101128 (166h50m37.717395806s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.792464349 (166h50m37.718759029s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793560375 (166h50m37.719855062s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793674978 (166h50m37.719969657s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.805707431 (166h50m37.732002111s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.808620050 (166h50m37.734914727s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.812691662 (166h50m37.738986335s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.817015454 (166h50m37.743310142s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.826452214 (166h50m37.752746893s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.830751774 (166h50m37.757046455s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.837694268 (166h50m37.763988946s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.910774346 (166h50m37.83706904s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1dReW9bUadCFKYw28ico3Wh4v97rJmffX9ZhS3eCCRMCG9qX6h, address:79.127.201.214:4301): protocol: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection Jun 30 08:02:10.911096576 (166h50m37.837391271s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf, address:79.127.201.214:4298): protocol: expected piece hash; context deadline exceeded; EOF Jun 30 08:02:10.911315947 (166h50m37.837610638s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk, address:64.49.13.140:4511): protocol: read tcp 159.223.143.39:42620->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911347308 (166h50m37.837642004s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9, address:64.49.13.137:4500): protocol: read tcp 159.223.143.39:54982->64.49.13.137:4500: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911385931 (166h50m37.837680618s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12NR52pweTqZNNMTyc1EHSbifDKB4awrnnb4megtZHwANSrR18T, address:79.127.205.233:4645): protocol: read tcp 159.223.143.39:57052->79.127.205.233:4645: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911435829 (166h50m37.837730525s) [seg_pos={0 0}, upload=133682]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 30 08:02:10.983099615 (166h50m37.909394303s) [upload=133682]: Done uploading segments... Jun 30 08:02:10.983130346 (166h50m37.909425039s) [upload=133682]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 947.749621ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 545.344076ms FAIL (2025-06-30 08:38:23 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== bjectBegin Jun 30 08:02:09.521526833 (166h50m36.447821528s) [upload=133682]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 30 08:02:10.707674536 (166h50m37.633969233s) [seg_pos={0 0}, upload=133682]: Begin upload segment... Jun 30 08:02:10.707741540 (166h50m37.634036235s) [seg_pos={0 0}, upload=133682]: Done begin upload segment. Jun 30 08:02:10.707765938 (166h50m37.634060615s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707787500 (166h50m37.634082202s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707865104 (166h50m37.634159798s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708236369 (166h50m37.634531062s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708243540 (166h50m37.634538238s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708574357 (166h50m37.634869047s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708620817 (166h50m37.634915512s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708903894 (166h50m37.635198583s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708942260 (166h50m37.635236952s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709222534 (166h50m37.635517333s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709268432 (166h50m37.635563124s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709620733 (166h50m37.635915425s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709912660 (166h50m37.636207352s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710245117 (166h50m37.636539803s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710532064 (166h50m37.636826754s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710854515 (166h50m37.637149206s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711081096 (166h50m37.637375791s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711231002 (166h50m37.637525691s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.785256160 (166h50m37.711550846s) [upload=133682]: Next returned nil segment Jun 30 08:02:10.785270524 (166h50m37.71156521s) [upload=133682]: Waiting for error group managing segments... Jun 30 08:02:10.788413774 (166h50m37.714708454s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.789506554 (166h50m37.715801233s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.791101128 (166h50m37.717395806s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.792464349 (166h50m37.718759029s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793560375 (166h50m37.719855062s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793674978 (166h50m37.719969657s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.805707431 (166h50m37.732002111s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.808620050 (166h50m37.734914727s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.812691662 (166h50m37.738986335s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.817015454 (166h50m37.743310142s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.826452214 (166h50m37.752746893s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.830751774 (166h50m37.757046455s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.837694268 (166h50m37.763988946s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.910774346 (166h50m37.83706904s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1dReW9bUadCFKYw28ico3Wh4v97rJmffX9ZhS3eCCRMCG9qX6h, address:79.127.201.214:4301): protocol: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection Jun 30 08:02:10.911096576 (166h50m37.837391271s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf, address:79.127.201.214:4298): protocol: expected piece hash; context deadline exceeded; EOF Jun 30 08:02:10.911315947 (166h50m37.837610638s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk, address:64.49.13.140:4511): protocol: read tcp 159.223.143.39:42620->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911347308 (166h50m37.837642004s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9, address:64.49.13.137:4500): protocol: read tcp 159.223.143.39:54982->64.49.13.137:4500: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911385931 (166h50m37.837680618s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12NR52pweTqZNNMTyc1EHSbifDKB4awrnnb4megtZHwANSrR18T, address:79.127.205.233:4645): protocol: read tcp 159.223.143.39:57052->79.127.205.233:4645: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911435829 (166h50m37.837730525s) [seg_pos={0 0}, upload=133682]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 30 08:02:10.983099615 (166h50m37.909394303s) [upload=133682]: Done uploading segments... Jun 30 08:02:10.983130346 (166h50m37.909425039s) [upload=133682]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 545.386147ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 557.936484ms FAIL (2025-06-30 08:38:01 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== bjectBegin Jun 30 08:02:09.521526833 (166h50m36.447821528s) [upload=133682]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 30 08:02:10.707674536 (166h50m37.633969233s) [seg_pos={0 0}, upload=133682]: Begin upload segment... Jun 30 08:02:10.707741540 (166h50m37.634036235s) [seg_pos={0 0}, upload=133682]: Done begin upload segment. Jun 30 08:02:10.707765938 (166h50m37.634060615s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707787500 (166h50m37.634082202s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707865104 (166h50m37.634159798s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708236369 (166h50m37.634531062s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708243540 (166h50m37.634538238s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708574357 (166h50m37.634869047s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708620817 (166h50m37.634915512s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708903894 (166h50m37.635198583s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708942260 (166h50m37.635236952s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709222534 (166h50m37.635517333s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709268432 (166h50m37.635563124s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709620733 (166h50m37.635915425s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709912660 (166h50m37.636207352s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710245117 (166h50m37.636539803s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710532064 (166h50m37.636826754s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710854515 (166h50m37.637149206s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711081096 (166h50m37.637375791s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711231002 (166h50m37.637525691s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.785256160 (166h50m37.711550846s) [upload=133682]: Next returned nil segment Jun 30 08:02:10.785270524 (166h50m37.71156521s) [upload=133682]: Waiting for error group managing segments... Jun 30 08:02:10.788413774 (166h50m37.714708454s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.789506554 (166h50m37.715801233s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.791101128 (166h50m37.717395806s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.792464349 (166h50m37.718759029s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793560375 (166h50m37.719855062s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793674978 (166h50m37.719969657s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.805707431 (166h50m37.732002111s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.808620050 (166h50m37.734914727s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.812691662 (166h50m37.738986335s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.817015454 (166h50m37.743310142s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.826452214 (166h50m37.752746893s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.830751774 (166h50m37.757046455s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.837694268 (166h50m37.763988946s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.910774346 (166h50m37.83706904s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1dReW9bUadCFKYw28ico3Wh4v97rJmffX9ZhS3eCCRMCG9qX6h, address:79.127.201.214:4301): protocol: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection Jun 30 08:02:10.911096576 (166h50m37.837391271s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf, address:79.127.201.214:4298): protocol: expected piece hash; context deadline exceeded; EOF Jun 30 08:02:10.911315947 (166h50m37.837610638s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk, address:64.49.13.140:4511): protocol: read tcp 159.223.143.39:42620->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911347308 (166h50m37.837642004s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9, address:64.49.13.137:4500): protocol: read tcp 159.223.143.39:54982->64.49.13.137:4500: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911385931 (166h50m37.837680618s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12NR52pweTqZNNMTyc1EHSbifDKB4awrnnb4megtZHwANSrR18T, address:79.127.205.233:4645): protocol: read tcp 159.223.143.39:57052->79.127.205.233:4645: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911435829 (166h50m37.837730525s) [seg_pos={0 0}, upload=133682]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 30 08:02:10.983099615 (166h50m37.909394303s) [upload=133682]: Done uploading segments... Jun 30 08:02:10.983130346 (166h50m37.909425039s) [upload=133682]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 557.970753ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 670.521308ms FAIL (2025-06-30 08:37:02 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== bjectBegin Jun 30 08:02:09.521526833 (166h50m36.447821528s) [upload=133682]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 30 08:02:10.707674536 (166h50m37.633969233s) [seg_pos={0 0}, upload=133682]: Begin upload segment... Jun 30 08:02:10.707741540 (166h50m37.634036235s) [seg_pos={0 0}, upload=133682]: Done begin upload segment. Jun 30 08:02:10.707765938 (166h50m37.634060615s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707787500 (166h50m37.634082202s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707865104 (166h50m37.634159798s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708236369 (166h50m37.634531062s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708243540 (166h50m37.634538238s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708574357 (166h50m37.634869047s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708620817 (166h50m37.634915512s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708903894 (166h50m37.635198583s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708942260 (166h50m37.635236952s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709222534 (166h50m37.635517333s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709268432 (166h50m37.635563124s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709620733 (166h50m37.635915425s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709912660 (166h50m37.636207352s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710245117 (166h50m37.636539803s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710532064 (166h50m37.636826754s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710854515 (166h50m37.637149206s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711081096 (166h50m37.637375791s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711231002 (166h50m37.637525691s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.785256160 (166h50m37.711550846s) [upload=133682]: Next returned nil segment Jun 30 08:02:10.785270524 (166h50m37.71156521s) [upload=133682]: Waiting for error group managing segments... Jun 30 08:02:10.788413774 (166h50m37.714708454s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.789506554 (166h50m37.715801233s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.791101128 (166h50m37.717395806s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.792464349 (166h50m37.718759029s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793560375 (166h50m37.719855062s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793674978 (166h50m37.719969657s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.805707431 (166h50m37.732002111s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.808620050 (166h50m37.734914727s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.812691662 (166h50m37.738986335s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.817015454 (166h50m37.743310142s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.826452214 (166h50m37.752746893s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.830751774 (166h50m37.757046455s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.837694268 (166h50m37.763988946s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.910774346 (166h50m37.83706904s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1dReW9bUadCFKYw28ico3Wh4v97rJmffX9ZhS3eCCRMCG9qX6h, address:79.127.201.214:4301): protocol: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection Jun 30 08:02:10.911096576 (166h50m37.837391271s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf, address:79.127.201.214:4298): protocol: expected piece hash; context deadline exceeded; EOF Jun 30 08:02:10.911315947 (166h50m37.837610638s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk, address:64.49.13.140:4511): protocol: read tcp 159.223.143.39:42620->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911347308 (166h50m37.837642004s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9, address:64.49.13.137:4500): protocol: read tcp 159.223.143.39:54982->64.49.13.137:4500: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911385931 (166h50m37.837680618s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12NR52pweTqZNNMTyc1EHSbifDKB4awrnnb4megtZHwANSrR18T, address:79.127.205.233:4645): protocol: read tcp 159.223.143.39:57052->79.127.205.233:4645: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911435829 (166h50m37.837730525s) [seg_pos={0 0}, upload=133682]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 30 08:02:10.983099615 (166h50m37.909394303s) [upload=133682]: Done uploading segments... Jun 30 08:02:10.983130346 (166h50m37.909425039s) [upload=133682]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 670.547428ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 493.045208ms FAIL (2025-06-30 08:36:00 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== bjectBegin Jun 30 08:02:09.521526833 (166h50m36.447821528s) [upload=133682]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 30 08:02:10.707674536 (166h50m37.633969233s) [seg_pos={0 0}, upload=133682]: Begin upload segment... Jun 30 08:02:10.707741540 (166h50m37.634036235s) [seg_pos={0 0}, upload=133682]: Done begin upload segment. Jun 30 08:02:10.707765938 (166h50m37.634060615s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707787500 (166h50m37.634082202s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707865104 (166h50m37.634159798s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708236369 (166h50m37.634531062s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708243540 (166h50m37.634538238s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708574357 (166h50m37.634869047s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708620817 (166h50m37.634915512s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708903894 (166h50m37.635198583s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708942260 (166h50m37.635236952s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709222534 (166h50m37.635517333s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709268432 (166h50m37.635563124s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709620733 (166h50m37.635915425s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709912660 (166h50m37.636207352s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710245117 (166h50m37.636539803s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710532064 (166h50m37.636826754s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710854515 (166h50m37.637149206s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711081096 (166h50m37.637375791s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711231002 (166h50m37.637525691s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.785256160 (166h50m37.711550846s) [upload=133682]: Next returned nil segment Jun 30 08:02:10.785270524 (166h50m37.71156521s) [upload=133682]: Waiting for error group managing segments... Jun 30 08:02:10.788413774 (166h50m37.714708454s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.789506554 (166h50m37.715801233s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.791101128 (166h50m37.717395806s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.792464349 (166h50m37.718759029s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793560375 (166h50m37.719855062s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793674978 (166h50m37.719969657s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.805707431 (166h50m37.732002111s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.808620050 (166h50m37.734914727s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.812691662 (166h50m37.738986335s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.817015454 (166h50m37.743310142s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.826452214 (166h50m37.752746893s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.830751774 (166h50m37.757046455s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.837694268 (166h50m37.763988946s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.910774346 (166h50m37.83706904s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1dReW9bUadCFKYw28ico3Wh4v97rJmffX9ZhS3eCCRMCG9qX6h, address:79.127.201.214:4301): protocol: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection Jun 30 08:02:10.911096576 (166h50m37.837391271s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf, address:79.127.201.214:4298): protocol: expected piece hash; context deadline exceeded; EOF Jun 30 08:02:10.911315947 (166h50m37.837610638s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk, address:64.49.13.140:4511): protocol: read tcp 159.223.143.39:42620->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911347308 (166h50m37.837642004s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9, address:64.49.13.137:4500): protocol: read tcp 159.223.143.39:54982->64.49.13.137:4500: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911385931 (166h50m37.837680618s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12NR52pweTqZNNMTyc1EHSbifDKB4awrnnb4megtZHwANSrR18T, address:79.127.205.233:4645): protocol: read tcp 159.223.143.39:57052->79.127.205.233:4645: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911435829 (166h50m37.837730525s) [seg_pos={0 0}, upload=133682]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 30 08:02:10.983099615 (166h50m37.909394303s) [upload=133682]: Done uploading segments... Jun 30 08:02:10.983130346 (166h50m37.909425039s) [upload=133682]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 493.072047ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 676.718504ms FAIL (2025-06-30 08:35:42 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== bjectBegin Jun 30 08:02:09.521526833 (166h50m36.447821528s) [upload=133682]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 30 08:02:10.707674536 (166h50m37.633969233s) [seg_pos={0 0}, upload=133682]: Begin upload segment... Jun 30 08:02:10.707741540 (166h50m37.634036235s) [seg_pos={0 0}, upload=133682]: Done begin upload segment. Jun 30 08:02:10.707765938 (166h50m37.634060615s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707787500 (166h50m37.634082202s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707865104 (166h50m37.634159798s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708236369 (166h50m37.634531062s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708243540 (166h50m37.634538238s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708574357 (166h50m37.634869047s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708620817 (166h50m37.634915512s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708903894 (166h50m37.635198583s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708942260 (166h50m37.635236952s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709222534 (166h50m37.635517333s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709268432 (166h50m37.635563124s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709620733 (166h50m37.635915425s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709912660 (166h50m37.636207352s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710245117 (166h50m37.636539803s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710532064 (166h50m37.636826754s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710854515 (166h50m37.637149206s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711081096 (166h50m37.637375791s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711231002 (166h50m37.637525691s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.785256160 (166h50m37.711550846s) [upload=133682]: Next returned nil segment Jun 30 08:02:10.785270524 (166h50m37.71156521s) [upload=133682]: Waiting for error group managing segments... Jun 30 08:02:10.788413774 (166h50m37.714708454s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.789506554 (166h50m37.715801233s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.791101128 (166h50m37.717395806s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.792464349 (166h50m37.718759029s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793560375 (166h50m37.719855062s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793674978 (166h50m37.719969657s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.805707431 (166h50m37.732002111s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.808620050 (166h50m37.734914727s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.812691662 (166h50m37.738986335s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.817015454 (166h50m37.743310142s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.826452214 (166h50m37.752746893s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.830751774 (166h50m37.757046455s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.837694268 (166h50m37.763988946s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.910774346 (166h50m37.83706904s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1dReW9bUadCFKYw28ico3Wh4v97rJmffX9ZhS3eCCRMCG9qX6h, address:79.127.201.214:4301): protocol: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection Jun 30 08:02:10.911096576 (166h50m37.837391271s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf, address:79.127.201.214:4298): protocol: expected piece hash; context deadline exceeded; EOF Jun 30 08:02:10.911315947 (166h50m37.837610638s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk, address:64.49.13.140:4511): protocol: read tcp 159.223.143.39:42620->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911347308 (166h50m37.837642004s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9, address:64.49.13.137:4500): protocol: read tcp 159.223.143.39:54982->64.49.13.137:4500: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911385931 (166h50m37.837680618s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12NR52pweTqZNNMTyc1EHSbifDKB4awrnnb4megtZHwANSrR18T, address:79.127.205.233:4645): protocol: read tcp 159.223.143.39:57052->79.127.205.233:4645: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911435829 (166h50m37.837730525s) [seg_pos={0 0}, upload=133682]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 30 08:02:10.983099615 (166h50m37.909394303s) [upload=133682]: Done uploading segments... Jun 30 08:02:10.983130346 (166h50m37.909425039s) [upload=133682]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 676.753859ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 511.838799ms FAIL (2025-06-30 08:35:20 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== bjectBegin Jun 30 08:02:09.521526833 (166h50m36.447821528s) [upload=133682]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 30 08:02:10.707674536 (166h50m37.633969233s) [seg_pos={0 0}, upload=133682]: Begin upload segment... Jun 30 08:02:10.707741540 (166h50m37.634036235s) [seg_pos={0 0}, upload=133682]: Done begin upload segment. Jun 30 08:02:10.707765938 (166h50m37.634060615s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707787500 (166h50m37.634082202s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707865104 (166h50m37.634159798s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708236369 (166h50m37.634531062s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708243540 (166h50m37.634538238s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708574357 (166h50m37.634869047s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708620817 (166h50m37.634915512s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708903894 (166h50m37.635198583s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708942260 (166h50m37.635236952s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709222534 (166h50m37.635517333s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709268432 (166h50m37.635563124s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709620733 (166h50m37.635915425s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709912660 (166h50m37.636207352s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710245117 (166h50m37.636539803s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710532064 (166h50m37.636826754s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710854515 (166h50m37.637149206s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711081096 (166h50m37.637375791s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711231002 (166h50m37.637525691s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.785256160 (166h50m37.711550846s) [upload=133682]: Next returned nil segment Jun 30 08:02:10.785270524 (166h50m37.71156521s) [upload=133682]: Waiting for error group managing segments... Jun 30 08:02:10.788413774 (166h50m37.714708454s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.789506554 (166h50m37.715801233s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.791101128 (166h50m37.717395806s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.792464349 (166h50m37.718759029s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793560375 (166h50m37.719855062s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793674978 (166h50m37.719969657s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.805707431 (166h50m37.732002111s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.808620050 (166h50m37.734914727s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.812691662 (166h50m37.738986335s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.817015454 (166h50m37.743310142s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.826452214 (166h50m37.752746893s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.830751774 (166h50m37.757046455s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.837694268 (166h50m37.763988946s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.910774346 (166h50m37.83706904s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1dReW9bUadCFKYw28ico3Wh4v97rJmffX9ZhS3eCCRMCG9qX6h, address:79.127.201.214:4301): protocol: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection Jun 30 08:02:10.911096576 (166h50m37.837391271s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf, address:79.127.201.214:4298): protocol: expected piece hash; context deadline exceeded; EOF Jun 30 08:02:10.911315947 (166h50m37.837610638s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk, address:64.49.13.140:4511): protocol: read tcp 159.223.143.39:42620->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911347308 (166h50m37.837642004s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9, address:64.49.13.137:4500): protocol: read tcp 159.223.143.39:54982->64.49.13.137:4500: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911385931 (166h50m37.837680618s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12NR52pweTqZNNMTyc1EHSbifDKB4awrnnb4megtZHwANSrR18T, address:79.127.205.233:4645): protocol: read tcp 159.223.143.39:57052->79.127.205.233:4645: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911435829 (166h50m37.837730525s) [seg_pos={0 0}, upload=133682]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 30 08:02:10.983099615 (166h50m37.909394303s) [upload=133682]: Done uploading segments... Jun 30 08:02:10.983130346 (166h50m37.909425039s) [upload=133682]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 511.867153ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 466.260373ms FAIL (2025-06-30 08:34:06 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== bjectBegin Jun 30 08:02:09.521526833 (166h50m36.447821528s) [upload=133682]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 30 08:02:10.707674536 (166h50m37.633969233s) [seg_pos={0 0}, upload=133682]: Begin upload segment... Jun 30 08:02:10.707741540 (166h50m37.634036235s) [seg_pos={0 0}, upload=133682]: Done begin upload segment. Jun 30 08:02:10.707765938 (166h50m37.634060615s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707787500 (166h50m37.634082202s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707865104 (166h50m37.634159798s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708236369 (166h50m37.634531062s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708243540 (166h50m37.634538238s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708574357 (166h50m37.634869047s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708620817 (166h50m37.634915512s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708903894 (166h50m37.635198583s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708942260 (166h50m37.635236952s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709222534 (166h50m37.635517333s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709268432 (166h50m37.635563124s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709620733 (166h50m37.635915425s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709912660 (166h50m37.636207352s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710245117 (166h50m37.636539803s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710532064 (166h50m37.636826754s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710854515 (166h50m37.637149206s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711081096 (166h50m37.637375791s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711231002 (166h50m37.637525691s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.785256160 (166h50m37.711550846s) [upload=133682]: Next returned nil segment Jun 30 08:02:10.785270524 (166h50m37.71156521s) [upload=133682]: Waiting for error group managing segments... Jun 30 08:02:10.788413774 (166h50m37.714708454s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.789506554 (166h50m37.715801233s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.791101128 (166h50m37.717395806s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.792464349 (166h50m37.718759029s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793560375 (166h50m37.719855062s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793674978 (166h50m37.719969657s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.805707431 (166h50m37.732002111s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.808620050 (166h50m37.734914727s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.812691662 (166h50m37.738986335s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.817015454 (166h50m37.743310142s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.826452214 (166h50m37.752746893s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.830751774 (166h50m37.757046455s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.837694268 (166h50m37.763988946s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.910774346 (166h50m37.83706904s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1dReW9bUadCFKYw28ico3Wh4v97rJmffX9ZhS3eCCRMCG9qX6h, address:79.127.201.214:4301): protocol: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection Jun 30 08:02:10.911096576 (166h50m37.837391271s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf, address:79.127.201.214:4298): protocol: expected piece hash; context deadline exceeded; EOF Jun 30 08:02:10.911315947 (166h50m37.837610638s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk, address:64.49.13.140:4511): protocol: read tcp 159.223.143.39:42620->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911347308 (166h50m37.837642004s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9, address:64.49.13.137:4500): protocol: read tcp 159.223.143.39:54982->64.49.13.137:4500: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911385931 (166h50m37.837680618s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12NR52pweTqZNNMTyc1EHSbifDKB4awrnnb4megtZHwANSrR18T, address:79.127.205.233:4645): protocol: read tcp 159.223.143.39:57052->79.127.205.233:4645: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911435829 (166h50m37.837730525s) [seg_pos={0 0}, upload=133682]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 30 08:02:10.983099615 (166h50m37.909394303s) [upload=133682]: Done uploading segments... Jun 30 08:02:10.983130346 (166h50m37.909425039s) [upload=133682]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 466.292486ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 507.441146ms FAIL (2025-06-30 08:33:35 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== bjectBegin Jun 30 08:02:09.521526833 (166h50m36.447821528s) [upload=133682]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 30 08:02:10.707674536 (166h50m37.633969233s) [seg_pos={0 0}, upload=133682]: Begin upload segment... Jun 30 08:02:10.707741540 (166h50m37.634036235s) [seg_pos={0 0}, upload=133682]: Done begin upload segment. Jun 30 08:02:10.707765938 (166h50m37.634060615s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707787500 (166h50m37.634082202s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707865104 (166h50m37.634159798s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708236369 (166h50m37.634531062s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708243540 (166h50m37.634538238s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708574357 (166h50m37.634869047s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708620817 (166h50m37.634915512s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708903894 (166h50m37.635198583s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708942260 (166h50m37.635236952s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709222534 (166h50m37.635517333s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709268432 (166h50m37.635563124s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709620733 (166h50m37.635915425s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709912660 (166h50m37.636207352s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710245117 (166h50m37.636539803s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710532064 (166h50m37.636826754s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710854515 (166h50m37.637149206s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711081096 (166h50m37.637375791s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711231002 (166h50m37.637525691s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.785256160 (166h50m37.711550846s) [upload=133682]: Next returned nil segment Jun 30 08:02:10.785270524 (166h50m37.71156521s) [upload=133682]: Waiting for error group managing segments... Jun 30 08:02:10.788413774 (166h50m37.714708454s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.789506554 (166h50m37.715801233s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.791101128 (166h50m37.717395806s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.792464349 (166h50m37.718759029s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793560375 (166h50m37.719855062s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793674978 (166h50m37.719969657s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.805707431 (166h50m37.732002111s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.808620050 (166h50m37.734914727s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.812691662 (166h50m37.738986335s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.817015454 (166h50m37.743310142s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.826452214 (166h50m37.752746893s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.830751774 (166h50m37.757046455s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.837694268 (166h50m37.763988946s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.910774346 (166h50m37.83706904s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1dReW9bUadCFKYw28ico3Wh4v97rJmffX9ZhS3eCCRMCG9qX6h, address:79.127.201.214:4301): protocol: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection Jun 30 08:02:10.911096576 (166h50m37.837391271s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf, address:79.127.201.214:4298): protocol: expected piece hash; context deadline exceeded; EOF Jun 30 08:02:10.911315947 (166h50m37.837610638s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk, address:64.49.13.140:4511): protocol: read tcp 159.223.143.39:42620->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911347308 (166h50m37.837642004s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9, address:64.49.13.137:4500): protocol: read tcp 159.223.143.39:54982->64.49.13.137:4500: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911385931 (166h50m37.837680618s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12NR52pweTqZNNMTyc1EHSbifDKB4awrnnb4megtZHwANSrR18T, address:79.127.205.233:4645): protocol: read tcp 159.223.143.39:57052->79.127.205.233:4645: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911435829 (166h50m37.837730525s) [seg_pos={0 0}, upload=133682]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 30 08:02:10.983099615 (166h50m37.909394303s) [upload=133682]: Done uploading segments... Jun 30 08:02:10.983130346 (166h50m37.909425039s) [upload=133682]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 507.574984ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 636.664676ms FAIL (2025-06-30 08:33:17 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== bjectBegin Jun 30 08:02:09.521526833 (166h50m36.447821528s) [upload=133682]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 30 08:02:10.707674536 (166h50m37.633969233s) [seg_pos={0 0}, upload=133682]: Begin upload segment... Jun 30 08:02:10.707741540 (166h50m37.634036235s) [seg_pos={0 0}, upload=133682]: Done begin upload segment. Jun 30 08:02:10.707765938 (166h50m37.634060615s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707787500 (166h50m37.634082202s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707865104 (166h50m37.634159798s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708236369 (166h50m37.634531062s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708243540 (166h50m37.634538238s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708574357 (166h50m37.634869047s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708620817 (166h50m37.634915512s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708903894 (166h50m37.635198583s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708942260 (166h50m37.635236952s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709222534 (166h50m37.635517333s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709268432 (166h50m37.635563124s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709620733 (166h50m37.635915425s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709912660 (166h50m37.636207352s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710245117 (166h50m37.636539803s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710532064 (166h50m37.636826754s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710854515 (166h50m37.637149206s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711081096 (166h50m37.637375791s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711231002 (166h50m37.637525691s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.785256160 (166h50m37.711550846s) [upload=133682]: Next returned nil segment Jun 30 08:02:10.785270524 (166h50m37.71156521s) [upload=133682]: Waiting for error group managing segments... Jun 30 08:02:10.788413774 (166h50m37.714708454s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.789506554 (166h50m37.715801233s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.791101128 (166h50m37.717395806s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.792464349 (166h50m37.718759029s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793560375 (166h50m37.719855062s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793674978 (166h50m37.719969657s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.805707431 (166h50m37.732002111s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.808620050 (166h50m37.734914727s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.812691662 (166h50m37.738986335s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.817015454 (166h50m37.743310142s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.826452214 (166h50m37.752746893s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.830751774 (166h50m37.757046455s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.837694268 (166h50m37.763988946s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.910774346 (166h50m37.83706904s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1dReW9bUadCFKYw28ico3Wh4v97rJmffX9ZhS3eCCRMCG9qX6h, address:79.127.201.214:4301): protocol: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection Jun 30 08:02:10.911096576 (166h50m37.837391271s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf, address:79.127.201.214:4298): protocol: expected piece hash; context deadline exceeded; EOF Jun 30 08:02:10.911315947 (166h50m37.837610638s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk, address:64.49.13.140:4511): protocol: read tcp 159.223.143.39:42620->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911347308 (166h50m37.837642004s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9, address:64.49.13.137:4500): protocol: read tcp 159.223.143.39:54982->64.49.13.137:4500: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911385931 (166h50m37.837680618s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12NR52pweTqZNNMTyc1EHSbifDKB4awrnnb4megtZHwANSrR18T, address:79.127.205.233:4645): protocol: read tcp 159.223.143.39:57052->79.127.205.233:4645: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911435829 (166h50m37.837730525s) [seg_pos={0 0}, upload=133682]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 30 08:02:10.983099615 (166h50m37.909394303s) [upload=133682]: Done uploading segments... Jun 30 08:02:10.983130346 (166h50m37.909425039s) [upload=133682]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 636.691587ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 518.049016ms FAIL (2025-06-30 08:33:00 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 13) ======LOGS====== bjectBegin Jun 30 08:02:09.521526833 (166h50m36.447821528s) [upload=133682]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 30 08:02:10.707674536 (166h50m37.633969233s) [seg_pos={0 0}, upload=133682]: Begin upload segment... Jun 30 08:02:10.707741540 (166h50m37.634036235s) [seg_pos={0 0}, upload=133682]: Done begin upload segment. Jun 30 08:02:10.707765938 (166h50m37.634060615s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707787500 (166h50m37.634082202s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.707865104 (166h50m37.634159798s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708236369 (166h50m37.634531062s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708243540 (166h50m37.634538238s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708574357 (166h50m37.634869047s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708620817 (166h50m37.634915512s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708903894 (166h50m37.635198583s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.708942260 (166h50m37.635236952s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709222534 (166h50m37.635517333s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709268432 (166h50m37.635563124s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709620733 (166h50m37.635915425s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.709912660 (166h50m37.636207352s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710245117 (166h50m37.636539803s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710532064 (166h50m37.636826754s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.710854515 (166h50m37.637149206s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711081096 (166h50m37.637375791s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.711231002 (166h50m37.637525691s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Uploading piece... Jun 30 08:02:10.785256160 (166h50m37.711550846s) [upload=133682]: Next returned nil segment Jun 30 08:02:10.785270524 (166h50m37.71156521s) [upload=133682]: Waiting for error group managing segments... Jun 30 08:02:10.788413774 (166h50m37.714708454s) [noise=true , address=77.90.31.14:4685 , piece_id=HLSGQA6ZENRSMLVV5LPAIAT7K65IDOCJJ6CCLXDW5KGSNFW3MICA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.789506554 (166h50m37.715801233s) [noise=true , address=79.127.219.48:4090 , piece_id=CIIDWX2AU3NUJRN6TUF2KTUXEAFS3NIIHILIFSYBY2PBEC7QAOMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.791101128 (166h50m37.717395806s) [noise=true , address=104.36.82.59:4318 , piece_id=GQRCVHIWSFBNTUMOLJZ62IFXZSZHGT55VA4T435TC5LBNKIYHVAA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.792464349 (166h50m37.718759029s) [noise=true , address=104.36.82.42:4827 , piece_id=KZT6GEOYYMFRASYPO3IGU2GOEL3DDDFKUNYFCMGNV6VROM3W7RRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793560375 (166h50m37.719855062s) [noise=true , address=104.36.82.23:4454 , piece_id=UJFITJT72VAPTNSYQZJXZSXI2LNNWIWPD2NAWKD72A5WM72GXGGA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.793674978 (166h50m37.719969657s) [noise=true , address=104.36.82.58:4298 , piece_id=6KIEUPARRSJOU3PDHQBNZEGR33B2RG5S2G6JIA4P3XFVMSZFE64A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.805707431 (166h50m37.732002111s) [noise=true , address=77.90.31.16:4768 , piece_id=IR5XFCCZQ5FAFL7JKUQFUJUHTCPSXVITY6XA2CKPCG4FYMWXZ6WQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.808620050 (166h50m37.734914727s) [noise=true , address=104.36.82.45:4920 , piece_id=AOXJJMIIDSLQL4KGY5FLE55ALXA5PLX3XAB2ZRBORKOPKOQ7NVQQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.812691662 (166h50m37.738986335s) [noise=true , address=104.36.82.60:4366 , piece_id=3Z7JJYOWNY325WDKOL4DKIC73UTTRZEJ3I6HEFMQFJTHHBGKKXIQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.817015454 (166h50m37.743310142s) [noise=true , address=104.36.82.44:4885 , piece_id=X3Q2JD4YDEZAYUFO7WM6FUQ5OL55A54XMJUDVN4UZPR4JPYRIAUA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.826452214 (166h50m37.752746893s) [noise=true , address=104.36.82.16:4303 , piece_id=IYMPOVGPPHETH5DZ5EJYZ4I5UYKR5PND56QFNTQQUK64CFEHE43A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.830751774 (166h50m37.757046455s) [noise=true , address=104.36.82.36:4642 , piece_id=TGHALZPYKUZF33UCNMPHQSGTAWMGHSDNA3EBKXRTOOH7HF22T4VA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.837694268 (166h50m37.763988946s) [noise=true , address=104.36.82.4:4814 , piece_id=KOZ5KLCLPL37RG6NEU2KSWEGI5FMGL6QGWBPSGZW7YUCKVMUUCNA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: <nil> Jun 30 08:02:10.910774346 (166h50m37.83706904s) [noise=true , address=79.127.201.214:4301 , piece_id=CJMHXFTBFYERDEBJF6XGAYRDJFD6S4J4SW7GMUUY35PCHFQILO4A, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1dReW9bUadCFKYw28ico3Wh4v97rJmffX9ZhS3eCCRMCG9qX6h, address:79.127.201.214:4301): protocol: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47414->79.127.201.214:4301: use of closed network connection Jun 30 08:02:10.911096576 (166h50m37.837391271s) [noise=true , address=79.127.201.214:4298 , piece_id=4M74NR7LEYYSDWZMWTDRS77N543LHEEOMT7XWX7IUPVRGQD4LLMQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12sPMiBw8jUE9WA15Z5Xyt4xgiNhy1HXQqcGkUgtaLzQpFAtCdf, address:79.127.201.214:4298): protocol: expected piece hash; context deadline exceeded; EOF Jun 30 08:02:10.911315947 (166h50m37.837610638s) [noise=true , address=64.49.13.140:4511 , piece_id=5ALWHV3JDHY7HFMXUJLFBUT3ZP6SEMWQLFQ3V3ZBL2LDPEQLW4PA, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:1F79nPRFzy9hjCq5KYvLy6bZERw9cEvczCN2o66Cf6ccKEpkAk, address:64.49.13.140:4511): protocol: read tcp 159.223.143.39:42620->64.49.13.140:4511: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911347308 (166h50m37.837642004s) [noise=true , address=64.49.13.137:4500 , piece_id=P4DZOV5FZZE2G4O67RJNOU5PJ2KAYE5YZP5V3IFF4N4DIXY2GMRQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:15TwVQ6CHDbtqS4XW86n9BuyjdqpaJo4ZKPgPnmhSm6EPDrnd9, address:64.49.13.137:4500): protocol: read tcp 159.223.143.39:54982->64.49.13.137:4500: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911385931 (166h50m37.837680618s) [noise=true , address=79.127.205.233:4645 , piece_id=IETCNOUY4TXAEQRLXB32Y3ZEG3QQEAR2FVEVZSIFGWRDLICI7QJQ, seg_pos={0 0}, upload=133682]: Done uploading piece. err: ecclient: upload failed (node:12NR52pweTqZNNMTyc1EHSbifDKB4awrnnb4megtZHwANSrR18T, address:79.127.205.233:4645): protocol: read tcp 159.223.143.39:57052->79.127.205.233:4645: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jun 30 08:02:10.911435829 (166h50m37.837730525s) [seg_pos={0 0}, upload=133682]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil> Jun 30 08:02:10.983099615 (166h50m37.909394303s) [upload=133682]: Done uploading segments... Jun 30 08:02:10.983130346 (166h50m37.909425039s) [upload=133682]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13) Duration:* 518.071478ms core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)