Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
685.381257ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:31:22 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 685.407796ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
678.593906ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:30:42 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 678.619836ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
687.327146ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:29:32 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 687.42352ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
685.571027ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:28:24 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 685.612064ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
698.404806ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:27:50 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 698.429709ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
682.206209ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:27:07 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 682.222849ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
678.031772ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:26:26 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 678.063669ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
667.800122ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:25:24 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 667.825798ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
681.886399ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:24:17 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 681.921886ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
673.429324ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:23:16 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 673.562686ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
686.664947ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:22:31 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 686.692915ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
669.293143ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:21:26 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 669.316995ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
681.620781ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:21:02 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 681.649174ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
769.930589ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:20:15 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 770.02661ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
677.885551ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:19:49 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 677.906782ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
668.921159ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:19:10 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 668.945696ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
712.207427ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:18:48 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 712.229016ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
672.687587ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:18:09 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 672.714135ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
678.244122ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:17:12 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 678.271163ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
676.278927ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:16:38 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 676.303327ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
676.925945ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:16:00 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 676.988564ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
678.44611ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:15:40 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 678.470682ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
663.763212ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:14:53 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 663.787239ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
685.039751ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:14:17 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 685.070058ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
741.148698ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:13:21 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 741.163026ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
672.880103ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:12:19 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 672.900636ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
679.804042ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:11:55 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 679.837805ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
686.364941ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:10:57 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 686.38994ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
682.46174ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:09:51 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 682.493252ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
699.634199ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:08:57 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 699.657999ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
675.318857ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:08:10 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 675.340359ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
676.662244ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:07:08 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 676.688348ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
682.477194ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:06:02 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 682.56736ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
691.020154ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:05:46 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 691.055359ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
678.211953ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:05:31 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 678.239545ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
698.822975ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:05:10 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 698.853076ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
687.297817ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:04:03 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 687.322336ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
685.506949ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:03:18 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 685.535634ms
core
satellite
ap1
|
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
228.765979ms target:
https://ap1.storj.io/login
FAIL (2025-06-26 22:02:30 UTC)
orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.126.92.94:443: connect: connection refused
Duration: 228.801655ms
core
satellite
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
1.034153792s
FAIL (2025-06-26 18:47:36 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
egments...
Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false
Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment...
Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment.
Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment
Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments...
Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces.
Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF
Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments...
Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil>
Duration: 1.034182456s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
644.894641ms
FAIL (2025-06-26 18:46:23 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
egments...
Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false
Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment...
Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment.
Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment
Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments...
Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces.
Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF
Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments...
Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil>
Duration: 644.92336ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
1.523926743s
FAIL (2025-06-26 18:45:09 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
egments...
Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false
Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment...
Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment.
Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment
Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments...
Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces.
Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF
Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments...
Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil>
Duration: 1.52395569s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
924.311537ms
FAIL (2025-06-26 18:44:23 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
egments...
Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false
Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment...
Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment.
Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment
Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments...
Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces.
Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF
Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments...
Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil>
Duration: 924.344906ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
1.030965496s
FAIL (2025-06-26 18:43:44 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
egments...
Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false
Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment...
Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment.
Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment
Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments...
Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces.
Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF
Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments...
Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil>
Duration: 1.030985353s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
1.332772365s
FAIL (2025-06-26 18:43:25 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
egments...
Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false
Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment...
Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment.
Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment
Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments...
Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces.
Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF
Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments...
Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil>
Duration: 1.332798304s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
1.043391071s
FAIL (2025-06-26 18:42:34 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
egments...
Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false
Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment...
Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment.
Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment
Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments...
Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces.
Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF
Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments...
Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil>
Duration: 1.043417469s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
1.03458212s
FAIL (2025-06-26 18:41:32 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
egments...
Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false
Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment...
Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment.
Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment
Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments...
Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces.
Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF
Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments...
Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil>
Duration: 1.034662548s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
1.13453628s
FAIL (2025-06-26 18:40:55 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
egments...
Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false
Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment...
Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment.
Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment
Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments...
Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces.
Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF
Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments...
Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil>
Duration: 1.134562089s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
1.215172053s
FAIL (2025-06-26 18:40:20 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
egments...
Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false
Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment...
Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment.
Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment
Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments...
Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces.
Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF
Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments...
Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil>
Duration: 1.215205813s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
901.252986ms
FAIL (2025-06-26 18:39:59 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
egments...
Jun 26 18:01:40.242804852 (80h50m7.169099544s) [upload=64908]: Got next segment. Inline: false
Jun 26 18:01:40.243455640 (80h50m7.169750343s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 26 18:01:40.243471333 (80h50m7.169766027s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 26 18:01:40.284410427 (80h50m7.210705279s) [seg_pos={0 0}, upload=64908]: Begin upload segment...
Jun 26 18:01:40.284481414 (80h50m7.210776105s) [seg_pos={0 0}, upload=64908]: Done begin upload segment.
Jun 26 18:01:40.284515546 (80h50m7.210810264s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285116924 (80h50m7.211411627s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285622174 (80h50m7.211916873s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.285999094 (80h50m7.212293788s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.286434105 (80h50m7.212728805s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.286875435 (80h50m7.21317014s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.287326440 (80h50m7.213621142s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.287720191 (80h50m7.214014885s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288074602 (80h50m7.214369296s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288455565 (80h50m7.214750266s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.288830800 (80h50m7.215125502s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289214983 (80h50m7.215509681s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289575807 (80h50m7.215870505s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.289862775 (80h50m7.216157473s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.290476076 (80h50m7.216770768s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.290974562 (80h50m7.217269258s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.291479916 (80h50m7.217774611s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.291992916 (80h50m7.218287609s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Uploading piece...
Jun 26 18:01:40.420482363 (80h50m7.346777044s) [upload=64908]: Next returned nil segment
Jun 26 18:01:40.420503216 (80h50m7.346797905s) [upload=64908]: Waiting for error group managing segments...
Jun 26 18:01:40.425488017 (80h50m7.351782701s) [noise=true , address=45.91.116.12:5245 , piece_id=POXYGEOTXHG2L5TI5LAK3256WVMKNP3QRMCGSXFH65HJX5WFQBBQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.438076791 (80h50m7.364371492s) [noise=true , address=104.36.82.62:4417 , piece_id=PLBW5U5IKVNFCT5KWU62PUE65QJYYGTJRUIYPLX434KPS7MNIYWA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.439878469 (80h50m7.366173147s) [noise=true , address=104.36.82.60:4352 , piece_id=S6ICLIKUJPBF2PPDU7KTH3WSWRKKZ7BXFXTYS4XOBT363MIBOTEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.441833040 (80h50m7.368127765s) [noise=true , address=104.36.82.23:4473 , piece_id=N7SODY56VVEX4AQI77BTBKYLISJWG5UGLB7K6B3OB4AS4T5QLIOQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.442912734 (80h50m7.369207431s) [noise=true , address=104.36.82.62:4436 , piece_id=3UHMDCJE2UQC6NL235QTSWIXMPI4GO5PEV4F3TEQOKVWRDYBXLNA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.446745836 (80h50m7.373040517s) [noise=true , address=104.36.82.61:4381 , piece_id=KYQT3KL44O3STTQB46EWTDFKGY5UHYXT6E3AVBASWNG45HCGEWCQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.457439468 (80h50m7.383734147s) [noise=true , address=104.36.82.59:4311 , piece_id=6ATVM2HLPOQUJFOCFA3XIYPA2P7TXBPDDVOULQAE7N2HBMMNNZQA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.461546978 (80h50m7.387841667s) [noise=true , address=104.36.82.5:4858 , piece_id=26V5JC2LXAOZGRMGTT4ESC6HJH2HQZOQN6NS2ABYZLMEADDAD4ZA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.461728053 (80h50m7.388022728s) [noise=true , address=104.36.82.6:4883 , piece_id=2TD4GZXLNMSWX2SXGI5NLCJEADO2BNQ4Y6FKUBGBNZJD7FIRNRUQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.469109186 (80h50m7.39540386s) [noise=true , address=45.91.116.7:4013 , piece_id=R3LGOMKOSHYJDPTRVSYYCZPK67YDIZ6JTIGS5ERUYBB77AGL7VBA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.472053208 (80h50m7.398347892s) [noise=true , address=104.36.82.15:4279 , piece_id=QHW23WKV6SIBKZA7A7J4HXI3YIE3WOM4V2T4HWYQ4DSY5YNMYR2A, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.490662453 (80h50m7.416957133s) [noise=true , address=104.36.82.9:4022 , piece_id=XKM4C6XPQTT4AKTJFZDLZ5BVQZQSTLLQ2C5IAEY5GFSGYW7EHWMA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.510954257 (80h50m7.437248936s) [noise=true , address=79.127.219.47:4043 , piece_id=PODCM4QS45OWEJSGTKAAGHJIMUUJG5KLTJTWTVYIXGZX5BZPWG6Q, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.525327556 (80h50m7.451622235s) [noise=true , address=104.36.82.2:4751 , piece_id=U4MJSQFF2GTN6CUJMMEKQSXKPAVNDVDZ4JKM63DECGHDLHSIJ3QQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: <nil>
Jun 26 18:01:40.525358071 (80h50m7.451652759s) [seg_pos={0 0}, upload=64908]: Segment reached optimal threshold of 14 pieces.
Jun 26 18:01:40.525890885 (80h50m7.452185568s) [noise=true , address=104.36.82.45:4910 , piece_id=YVPOVUHFTHNHE6SY7MSJGJJVDOMXKO22RR6JR35EG3ESZDYKIJEA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bRYzNggkq7QWFTP9fB94dTrMMX8AYvKMt2zjmJBzT1VwqyPVZ): protocol: expected piece hash; context canceled; EOF
Jun 26 18:01:40.526391488 (80h50m7.452686176s) [noise=true , address=64.49.13.155:4914 , piece_id=Z3MP3OBNYBHHG5OG6BT7374LYCUSFT72G4CLREU7UXPX4CBNMPQQ, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:123exKWZgTdDY8ojhiFcaXkAQnsVs2MZp5MWfcaPiwk5f5tFR9A): protocol: read tcp 159.223.143.39:59474->64.49.13.155:4914: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526452431 (80h50m7.45274711s) [noise=true , address=79.127.201.214:4314 , piece_id=J5MBM45BABSPJGUP473U6DHNKQQCIYTPY6RRNYOQAHSGPF6B4IFA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WrUosyjTyEEWBt8svrbWmxupG4Uu9tWB7Bkn92YWujHeiJgGe): protocol: read tcp 159.223.143.39:54684->79.127.201.214:4314: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526529455 (80h50m7.452824133s) [noise=true , address=64.49.13.27:4960 , piece_id=YJARYQGSMOYHC4TJRJFPXMJ47ETAHSAGDV4BWVGDMIWSYOQGRJJA, seg_pos={0 0}, upload=64908]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1b9E6CZV6RerwQz1udw1V1BcQiFmNorppmt4927aSGDPjEaxzr): protocol: read tcp 159.223.143.39:35318->64.49.13.27:4960: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jun 26 18:01:40.526547305 (80h50m7.452841994s) [seg_pos={0 0}, upload=64908]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jun 26 18:01:40.526658905 (80h50m7.452953595s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 26 18:01:40.526665056 (80h50m7.452959747s) [upload=64908]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 26 18:01:40.593771847 (80h50m7.520066549s) [upload=64908]: Done uploading segments...
Jun 26 18:01:40.593792541 (80h50m7.520087217s) [upload=64908]: Upload finished. err: <nil>
Duration: 901.288957ms
core
uplink
us-select-1
us1-placement-20
|