Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 149946 reports (Page 2782 of 2999)
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............]
duration:
17.22751168s
FAIL (2025-07-09 21:54:48 UTC)
orbiter warning: context deadline exceeded
Duration: 17.227553326s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [..............................................X........X....]
duration:
577.789433ms
FAIL (2025-07-09 21:54:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 577.809065ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration:
22.877661589s
FAIL (2025-07-09 21:54:07 UTC)
orbiter warning: context deadline exceeded
Duration: 22.877718162s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration:
38.32134696s
FAIL (2025-07-09 21:53:26 UTC)
orbiter warning: context deadline exceeded
Duration: 38.321371327s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [...............................................X........X...]
duration:
3.070679096s
FAIL (2025-07-09 21:52:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.070693946s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............]
duration:
25.478180877s
FAIL (2025-07-09 21:52:39 UTC)
orbiter warning: context deadline exceeded
Duration: 25.478240203s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [................................................X........X..]
duration:
493.6015ms
FAIL (2025-07-09 21:52:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 493.63872ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........]
duration:
26.848982637s
FAIL (2025-07-09 21:51:52 UTC)
orbiter warning: context deadline exceeded
Duration: 26.848997729s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.................................................X........X.]
duration:
906.131262ms
FAIL (2025-07-09 21:51:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 906.145354ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [..................................................X........X]
duration:
30.001868915s
FAIL (2025-07-09 21:51:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001884214s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration:
32.710828871s
FAIL (2025-07-09 21:50:52 UTC)
orbiter warning: context deadline exceeded
Duration: 32.710891271s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........]
duration:
637.302459ms
FAIL (2025-07-09 21:50:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 637.340288ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration:
37.760882043s
FAIL (2025-07-09 21:50:19 UTC)
orbiter warning: context deadline exceeded
Duration: 37.760907986s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration:
541.670678ms
FAIL (2025-07-09 21:49:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 541.733818ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
5.99892022s
FAIL (2025-07-09 21:49:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.998950947s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........]
duration:
41.379426009s
FAIL (2025-07-09 21:49:31 UTC)
orbiter warning: context deadline exceeded
Duration: 41.3794412s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration:
51.50506303s
FAIL (2025-07-09 21:48:50 UTC)
orbiter warning: context deadline exceeded
Duration: 51.505086541s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
504.207ms
FAIL (2025-07-09 21:48:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 504.231678ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
17.019719405s
FAIL (2025-07-09 21:48:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 17.019784657s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
40.31300821s
FAIL (2025-07-09 21:47:27 UTC)
orbiter warning: context deadline exceeded
Duration: 40.313067853s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
597.853808ms
FAIL (2025-07-09 21:46:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 597.88768ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
37.596463204s
FAIL (2025-07-09 21:46:47 UTC)
orbiter warning: context deadline exceeded
Duration: 37.596539871s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
27.34873685s
FAIL (2025-07-09 21:46:08 UTC)
orbiter warning: context deadline exceeded
Duration: 27.348763733s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
963.873267ms
FAIL (2025-07-09 21:46:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 963.93196ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
22.19047344s
FAIL (2025-07-09 21:45:40 UTC)
orbiter warning: context deadline exceeded
Duration: 22.190544254s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [X.........................................................X.]
duration:
500.189844ms
FAIL (2025-07-09 21:45:29 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 500.207806ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [XX.........................................................X]
duration:
30.001052188s
FAIL (2025-07-09 21:45:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001075408s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
25.209023975s
FAIL (2025-07-09 21:44:50 UTC)
orbiter warning: context deadline exceeded
Duration: 25.209040009s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
2 out of 60 is failed (threshold=3) [X.........................................................X.]
duration:
31.734391466s
FAIL (2025-07-09 21:44:25 UTC)
orbiter warning: context deadline exceeded
Duration: 31.73440586s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
2 out of 60 is failed (threshold=3) [.X.........................................................X]
duration:
1m0.001052039s
FAIL (2025-07-09 21:43:53 UTC)
orbiter warning: context deadline exceeded
Duration: 1m0.001069938s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.XX.........................................................]
duration:
478.317869ms
FAIL (2025-07-09 21:43:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 478.367039ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................]
duration:
32.519379243s
FAIL (2025-07-09 21:42:53 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 32.519397745s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [..XX........................................................]
duration:
706.372782ms
FAIL (2025-07-09 21:42:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 706.403759ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [...XX.......................................................]
duration:
505.47215ms
FAIL (2025-07-09 21:42:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 505.491369ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................]
duration:
30.932812105s
FAIL (2025-07-09 21:42:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.932843687s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [....XX......................................................]
duration:
569.21345ms
FAIL (2025-07-09 21:42:05 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 569.24138ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................]
duration:
29.339837268s
FAIL (2025-07-09 21:41:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 29.339878597s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.....XX.....................................................]
duration:
976.31463ms
FAIL (2025-07-09 21:41:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 976.365193ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................]
duration:
59.190927255s
FAIL (2025-07-09 21:40:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 59.190958374s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [......XX....................................................]
duration:
7.749403878s
FAIL (2025-07-09 21:40:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 7.749448176s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................]
duration:
37.218100735s
FAIL (2025-07-09 21:39:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 37.218129228s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.......XX...................................................]
duration:
986.483166ms
FAIL (2025-07-09 21:39:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 986.508218ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................]
duration:
31.933998107s
FAIL (2025-07-09 21:38:46 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
upload=316819]: Done starting upload
Jul  9 20:51:01.744640664 (395h39m28.670935357s) [upload=316819]: Uploading segments...
Jul  9 20:51:01.745376443 (395h39m28.671671133s) [upload=316819]: Got next segment. Inline: false
Jul  9 20:51:01.745525760 (395h39m28.67182045s) [upload=316819]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  9 20:51:01.745533412 (395h39m28.671828085s) [upload=316819]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  9 20:51:01.783911087 (395h39m28.710205769s) [seg_pos={0 0}, upload=316819]: Begin upload segment...
Jul  9 20:51:01.783977239 (395h39m28.710271934s) [seg_pos={0 0}, upload=316819]: Done begin upload segment.
Jul  9 20:51:01.784009016 (395h39m28.710303716s) [noise=true , address=45.91.95.2:4009      , piece_id=WJMTOBG6FMEPZRVITBAYY2YSUEAQLYRG2VOVUVLDXJPXZ4GQQLZQ, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.784481955 (395h39m28.710776649s) [noise=true , address=77.90.31.14:4678     , piece_id=HBT23VUKCRDCJWMP5UYHAJ52UPO23PP44VXAPXR7Q73ZMORPGPPQ, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.784908723 (395h39m28.711203414s) [noise=true , address=77.90.31.11:4578     , piece_id=CTRGOFGYL5GM5LHG34IRIDUEOY6RKZ3HZORKJW7XKVRBW55ZRE3Q, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.785241082 (395h39m28.711535772s) [noise=true , address=77.90.31.17:4784     , piece_id=6NMQWGOJPBS5U76BMHCTI3RBXDHX3727ULH4US35W7IVXHAQPPQA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.785533991 (395h39m28.711828684s) [noise=true , address=77.90.31.15:4709     , piece_id=XFWO5EKOOSN6OBFIWI24F7TCRUSPMZIIN3DOEL2ERZ3VOITY773A, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.785835130 (395h39m28.71212983s) [noise=true , address=45.91.116.5:4315     , piece_id=4DU4MG7F55AV65OBOLWNZW5WPRHWPT5JDLYCS3W7P22ITVQ4ONKA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.786163209 (395h39m28.712457905s) [noise=true , address=45.91.95.4:4001      , piece_id=TMC2S53RJT4CZVVDNTXXKXOEVATBGSHCSUBU2NZLF6QWSBA7XZAQ, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.786710678 (395h39m28.713005376s) [noise=true , address=45.91.95.3:4033      , piece_id=GTYIDWLQNZDKKDTJ4WR23XUATGH2KJEO6AZOV6INJOPRNGZZY6XQ, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.787413905 (395h39m28.713708604s) [noise=true , address=104.36.82.3:4782     , piece_id=SRHJ3DNPI4ZK6NRDMCNLYJR6MIHTGVMA4WZEVAP4FSSBWUVQKSEQ, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.788027996 (395h39m28.714322693s) [noise=true , address=77.90.31.13:4632     , piece_id=4PFLEHBC46MBNEWKJYKCZ66JXTQA7H5OTRHGGEMZQ33NNAVWFUMA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.788820165 (395h39m28.715114861s) [noise=true , address=104.36.82.44:4892    , piece_id=NARCZA3HD2V5W7UZGLDAOBZ62ZQS243R2CSXG3XGDS4JMTRREN2Q, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.789282608 (395h39m28.715577305s) [noise=true , address=45.91.95.5:4012      , piece_id=K7V4QEUEO4QNA5ALS6C5R5ST5P5NXRP33MFN4X4JIBOVK7XUQZJA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.789720674 (395h39m28.716015375s) [noise=true , address=77.90.31.21:4880     , piece_id=AGTABQXZT3L2NRSSXBZT7P7OVRA5TTSK4PPXITDFHQ46BQBODGHA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.790132999 (395h39m28.716427699s) [noise=true , address=104.36.82.6:4906     , piece_id=JWKITIOBS27IKAOVSHXT4IM5EYX47UTAGHL6XANGDNK56DCPLHDA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.790759994 (395h39m28.71705469s) [noise=true , address=104.36.82.23:4464    , piece_id=REM6P63TU6YH4FQNTUIMKSL34LFEKWJR2PNY364277A23GB47DYA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.795058621 (395h39m28.721353314s) [noise=true , address=77.90.31.10:4523     , piece_id=SPWYFTHRZXVJVDII6CS2RUVLSVZOAGWKUJNCKU2VPSYRPTPEVO3Q, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.795650095 (395h39m28.721944823s) [noise=true , address=104.36.82.19:4403    , piece_id=A2DCQOGRLU4SKPAFLL7RR7HRSSRH3TTPU7XIOWHO6AWOT3OWHXXA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.798606176 (395h39m28.724900871s) [noise=true , address=77.90.31.19:4860     , piece_id=OM4TEL3C5R3N4KBHP5KRO6LBIB3LLXBCEKOEPRCSNKFT2H24FZBA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.909993379 (395h39m28.836288058s) [upload=316819]: Next returned nil segment
Jul  9 20:51:01.910016191 (395h39m28.83631089s) [upload=316819]: Waiting for error group managing segments...
Jul  9 20:51:01.919116414 (395h39m28.845411096s) [noise=true , address=77.90.31.14:4678     , piece_id=HBT23VUKCRDCJWMP5UYHAJ52UPO23PP44VXAPXR7Q73ZMORPGPPQ, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:01.919780312 (395h39m28.846074986s) [noise=true , address=77.90.31.11:4578     , piece_id=CTRGOFGYL5GM5LHG34IRIDUEOY6RKZ3HZORKJW7XKVRBW55ZRE3Q, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:01.920354582 (395h39m28.846649276s) [noise=true , address=77.90.31.21:4880     , piece_id=AGTABQXZT3L2NRSSXBZT7P7OVRA5TTSK4PPXITDFHQ46BQBODGHA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:01.921019660 (395h39m28.847314356s) [noise=true , address=77.90.31.17:4784     , piece_id=6NMQWGOJPBS5U76BMHCTI3RBXDHX3727ULH4US35W7IVXHAQPPQA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:01.922603097 (395h39m28.848897786s) [noise=true , address=77.90.31.13:4632     , piece_id=4PFLEHBC46MBNEWKJYKCZ66JXTQA7H5OTRHGGEMZQ33NNAVWFUMA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:01.932689000 (395h39m28.858983677s) [noise=true , address=77.90.31.19:4860     , piece_id=OM4TEL3C5R3N4KBHP5KRO6LBIB3LLXBCEKOEPRCSNKFT2H24FZBA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:01.934674660 (395h39m28.86096935s) [noise=true , address=77.90.31.15:4709     , piece_id=XFWO5EKOOSN6OBFIWI24F7TCRUSPMZIIN3DOEL2ERZ3VOITY773A, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:01.936194700 (395h39m28.862489378s) [noise=true , address=77.90.31.10:4523     , piece_id=SPWYFTHRZXVJVDII6CS2RUVLSVZOAGWKUJNCKU2VPSYRPTPEVO3Q, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:02.795832904 (395h39m29.722127608s) [noise=true , address=45.91.95.2:4009      , piece_id=WJMTOBG6FMEPZRVITBAYY2YSUEAQLYRG2VOVUVLDXJPXZ4GQQLZQ, seg_pos={0 0}, upload=316819]: Done uploading piece. err: ecclient: upload failed (node:1SrEo4XQ8dBq87CWMuQvExnt7TuL9JbwXqFSehpJ6pPsCHBAi6, address:45.91.95.2:4009): protocol: storage node overloaded, request limit: 2000
Jul  9 20:51:03.997629008 (395h39m30.923923684s) [noise=true , address=45.91.95.3:4033      , piece_id=GTYIDWLQNZDKKDTJ4WR23XUATGH2KJEO6AZOV6INJOPRNGZZY6XQ, seg_pos={0 0}, upload=316819]: Done uploading piece. err: ecclient: upload failed (node:12p7yU1B5SZNrV43Fd8jJr2FSykKDV1QsVgTCNgcBMtB46DazUD, address:45.91.95.3:4033): protocol: storage node overloaded, request limit: 2000
Jul  9 20:51:04.680596617 (395h39m31.606891297s) [noise=true , address=45.91.116.5:4315     , piece_id=4DU4MG7F55AV65OBOLWNZW5WPRHWPT5JDLYCS3W7P22ITVQ4ONKA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:06.998485262 (395h39m33.924779955s) [noise=true , address=45.91.95.5:4012      , piece_id=K7V4QEUEO4QNA5ALS6C5R5ST5P5NXRP33MFN4X4JIBOVK7XUQZJA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: ecclient: upload failed (node:121sqZ4w3zPsKS2g6ufEhdqzBnZcws9558iAfpfrKxdEm6LhA5S, address:45.91.95.5:4012): protocol: storage node overloaded, request limit: 2000
Jul  9 20:51:22.922410916 (395h39m49.848705597s) [noise=true , address=104.36.82.23:4464    , piece_id=REM6P63TU6YH4FQNTUIMKSL34LFEKWJR2PNY364277A23GB47DYA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:29.420748222 (395h39m56.347042898s) [noise=true , address=45.91.95.4:4001      , piece_id=TMC2S53RJT4CZVVDNTXXKXOEVATBGSHCSUBU2NZLF6QWSBA7XZAQ, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:31.417155305 (395h39m58.343450001s) [noise=true , address=104.36.82.6:4906     , piece_id=JWKITIOBS27IKAOVSHXT4IM5EYX47UTAGHL6XANGDNK56DCPLHDA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:42.331922832 (395h40m9.258217513s) [noise=true , address=104.36.82.3:4782     , piece_id=SRHJ3DNPI4ZK6NRDMCNLYJR6MIHTGVMA4WZEVAP4FSSBWUVQKSEQ, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:52:01.708814311 (395h40m28.635109007s) [noise=true , address=104.36.82.19:4403    , piece_id=A2DCQOGRLU4SKPAFLL7RR7HRSSRH3TTPU7XIOWHO6AWOT3OWHXXA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:104.36.82.19:4403): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 20:52:01.708928322 (395h40m28.635223001s) [noise=true , address=104.36.82.44:4892    , piece_id=NARCZA3HD2V5W7UZGLDAOBZ62ZQS243R2CSXG3XGDS4JMTRREN2Q, seg_pos={0 0}, upload=316819]: Done uploading piece. err: ecclient: upload failed (node:12RHwFxcUjPsn12uHEAH3fBDJKv1v1tM8mRJXoFrZrG5djdswF5, address:104.36.82.44:4892): protocol: write tcp 159.223.143.39:57578->104.36.82.44:4892: use of closed network connection; write tcp 159.223.143.39:57578->104.36.82.44:4892: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:57578->104.36.82.44:4892: use of closed network connection
Jul  9 20:52:01.708993102 (395h40m28.635287793s) [seg_pos={0 0}, upload=316819]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul  9 20:52:01.734227352 (395h40m28.66052204s) [upload=316819]: Done uploading segments...
Jul  9 20:52:01.734255282 (395h40m28.660549975s) [upload=316819]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 31.934019108s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................]
duration:
31.819164422s
FAIL (2025-07-09 21:38:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 31.81918885s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [........XX..................................................]
duration:
5.87029613s
FAIL (2025-07-09 21:38:17 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.870318242s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................]
duration:
10.808937658s
FAIL (2025-07-09 21:37:39 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
upload=316819]: Done starting upload
Jul  9 20:51:01.744640664 (395h39m28.670935357s) [upload=316819]: Uploading segments...
Jul  9 20:51:01.745376443 (395h39m28.671671133s) [upload=316819]: Got next segment. Inline: false
Jul  9 20:51:01.745525760 (395h39m28.67182045s) [upload=316819]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  9 20:51:01.745533412 (395h39m28.671828085s) [upload=316819]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  9 20:51:01.783911087 (395h39m28.710205769s) [seg_pos={0 0}, upload=316819]: Begin upload segment...
Jul  9 20:51:01.783977239 (395h39m28.710271934s) [seg_pos={0 0}, upload=316819]: Done begin upload segment.
Jul  9 20:51:01.784009016 (395h39m28.710303716s) [noise=true , address=45.91.95.2:4009      , piece_id=WJMTOBG6FMEPZRVITBAYY2YSUEAQLYRG2VOVUVLDXJPXZ4GQQLZQ, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.784481955 (395h39m28.710776649s) [noise=true , address=77.90.31.14:4678     , piece_id=HBT23VUKCRDCJWMP5UYHAJ52UPO23PP44VXAPXR7Q73ZMORPGPPQ, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.784908723 (395h39m28.711203414s) [noise=true , address=77.90.31.11:4578     , piece_id=CTRGOFGYL5GM5LHG34IRIDUEOY6RKZ3HZORKJW7XKVRBW55ZRE3Q, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.785241082 (395h39m28.711535772s) [noise=true , address=77.90.31.17:4784     , piece_id=6NMQWGOJPBS5U76BMHCTI3RBXDHX3727ULH4US35W7IVXHAQPPQA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.785533991 (395h39m28.711828684s) [noise=true , address=77.90.31.15:4709     , piece_id=XFWO5EKOOSN6OBFIWI24F7TCRUSPMZIIN3DOEL2ERZ3VOITY773A, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.785835130 (395h39m28.71212983s) [noise=true , address=45.91.116.5:4315     , piece_id=4DU4MG7F55AV65OBOLWNZW5WPRHWPT5JDLYCS3W7P22ITVQ4ONKA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.786163209 (395h39m28.712457905s) [noise=true , address=45.91.95.4:4001      , piece_id=TMC2S53RJT4CZVVDNTXXKXOEVATBGSHCSUBU2NZLF6QWSBA7XZAQ, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.786710678 (395h39m28.713005376s) [noise=true , address=45.91.95.3:4033      , piece_id=GTYIDWLQNZDKKDTJ4WR23XUATGH2KJEO6AZOV6INJOPRNGZZY6XQ, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.787413905 (395h39m28.713708604s) [noise=true , address=104.36.82.3:4782     , piece_id=SRHJ3DNPI4ZK6NRDMCNLYJR6MIHTGVMA4WZEVAP4FSSBWUVQKSEQ, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.788027996 (395h39m28.714322693s) [noise=true , address=77.90.31.13:4632     , piece_id=4PFLEHBC46MBNEWKJYKCZ66JXTQA7H5OTRHGGEMZQ33NNAVWFUMA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.788820165 (395h39m28.715114861s) [noise=true , address=104.36.82.44:4892    , piece_id=NARCZA3HD2V5W7UZGLDAOBZ62ZQS243R2CSXG3XGDS4JMTRREN2Q, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.789282608 (395h39m28.715577305s) [noise=true , address=45.91.95.5:4012      , piece_id=K7V4QEUEO4QNA5ALS6C5R5ST5P5NXRP33MFN4X4JIBOVK7XUQZJA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.789720674 (395h39m28.716015375s) [noise=true , address=77.90.31.21:4880     , piece_id=AGTABQXZT3L2NRSSXBZT7P7OVRA5TTSK4PPXITDFHQ46BQBODGHA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.790132999 (395h39m28.716427699s) [noise=true , address=104.36.82.6:4906     , piece_id=JWKITIOBS27IKAOVSHXT4IM5EYX47UTAGHL6XANGDNK56DCPLHDA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.790759994 (395h39m28.71705469s) [noise=true , address=104.36.82.23:4464    , piece_id=REM6P63TU6YH4FQNTUIMKSL34LFEKWJR2PNY364277A23GB47DYA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.795058621 (395h39m28.721353314s) [noise=true , address=77.90.31.10:4523     , piece_id=SPWYFTHRZXVJVDII6CS2RUVLSVZOAGWKUJNCKU2VPSYRPTPEVO3Q, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.795650095 (395h39m28.721944823s) [noise=true , address=104.36.82.19:4403    , piece_id=A2DCQOGRLU4SKPAFLL7RR7HRSSRH3TTPU7XIOWHO6AWOT3OWHXXA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.798606176 (395h39m28.724900871s) [noise=true , address=77.90.31.19:4860     , piece_id=OM4TEL3C5R3N4KBHP5KRO6LBIB3LLXBCEKOEPRCSNKFT2H24FZBA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.909993379 (395h39m28.836288058s) [upload=316819]: Next returned nil segment
Jul  9 20:51:01.910016191 (395h39m28.83631089s) [upload=316819]: Waiting for error group managing segments...
Jul  9 20:51:01.919116414 (395h39m28.845411096s) [noise=true , address=77.90.31.14:4678     , piece_id=HBT23VUKCRDCJWMP5UYHAJ52UPO23PP44VXAPXR7Q73ZMORPGPPQ, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:01.919780312 (395h39m28.846074986s) [noise=true , address=77.90.31.11:4578     , piece_id=CTRGOFGYL5GM5LHG34IRIDUEOY6RKZ3HZORKJW7XKVRBW55ZRE3Q, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:01.920354582 (395h39m28.846649276s) [noise=true , address=77.90.31.21:4880     , piece_id=AGTABQXZT3L2NRSSXBZT7P7OVRA5TTSK4PPXITDFHQ46BQBODGHA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:01.921019660 (395h39m28.847314356s) [noise=true , address=77.90.31.17:4784     , piece_id=6NMQWGOJPBS5U76BMHCTI3RBXDHX3727ULH4US35W7IVXHAQPPQA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:01.922603097 (395h39m28.848897786s) [noise=true , address=77.90.31.13:4632     , piece_id=4PFLEHBC46MBNEWKJYKCZ66JXTQA7H5OTRHGGEMZQ33NNAVWFUMA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:01.932689000 (395h39m28.858983677s) [noise=true , address=77.90.31.19:4860     , piece_id=OM4TEL3C5R3N4KBHP5KRO6LBIB3LLXBCEKOEPRCSNKFT2H24FZBA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:01.934674660 (395h39m28.86096935s) [noise=true , address=77.90.31.15:4709     , piece_id=XFWO5EKOOSN6OBFIWI24F7TCRUSPMZIIN3DOEL2ERZ3VOITY773A, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:01.936194700 (395h39m28.862489378s) [noise=true , address=77.90.31.10:4523     , piece_id=SPWYFTHRZXVJVDII6CS2RUVLSVZOAGWKUJNCKU2VPSYRPTPEVO3Q, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:02.795832904 (395h39m29.722127608s) [noise=true , address=45.91.95.2:4009      , piece_id=WJMTOBG6FMEPZRVITBAYY2YSUEAQLYRG2VOVUVLDXJPXZ4GQQLZQ, seg_pos={0 0}, upload=316819]: Done uploading piece. err: ecclient: upload failed (node:1SrEo4XQ8dBq87CWMuQvExnt7TuL9JbwXqFSehpJ6pPsCHBAi6, address:45.91.95.2:4009): protocol: storage node overloaded, request limit: 2000
Jul  9 20:51:03.997629008 (395h39m30.923923684s) [noise=true , address=45.91.95.3:4033      , piece_id=GTYIDWLQNZDKKDTJ4WR23XUATGH2KJEO6AZOV6INJOPRNGZZY6XQ, seg_pos={0 0}, upload=316819]: Done uploading piece. err: ecclient: upload failed (node:12p7yU1B5SZNrV43Fd8jJr2FSykKDV1QsVgTCNgcBMtB46DazUD, address:45.91.95.3:4033): protocol: storage node overloaded, request limit: 2000
Jul  9 20:51:04.680596617 (395h39m31.606891297s) [noise=true , address=45.91.116.5:4315     , piece_id=4DU4MG7F55AV65OBOLWNZW5WPRHWPT5JDLYCS3W7P22ITVQ4ONKA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:06.998485262 (395h39m33.924779955s) [noise=true , address=45.91.95.5:4012      , piece_id=K7V4QEUEO4QNA5ALS6C5R5ST5P5NXRP33MFN4X4JIBOVK7XUQZJA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: ecclient: upload failed (node:121sqZ4w3zPsKS2g6ufEhdqzBnZcws9558iAfpfrKxdEm6LhA5S, address:45.91.95.5:4012): protocol: storage node overloaded, request limit: 2000
Jul  9 20:51:22.922410916 (395h39m49.848705597s) [noise=true , address=104.36.82.23:4464    , piece_id=REM6P63TU6YH4FQNTUIMKSL34LFEKWJR2PNY364277A23GB47DYA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:29.420748222 (395h39m56.347042898s) [noise=true , address=45.91.95.4:4001      , piece_id=TMC2S53RJT4CZVVDNTXXKXOEVATBGSHCSUBU2NZLF6QWSBA7XZAQ, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:31.417155305 (395h39m58.343450001s) [noise=true , address=104.36.82.6:4906     , piece_id=JWKITIOBS27IKAOVSHXT4IM5EYX47UTAGHL6XANGDNK56DCPLHDA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:42.331922832 (395h40m9.258217513s) [noise=true , address=104.36.82.3:4782     , piece_id=SRHJ3DNPI4ZK6NRDMCNLYJR6MIHTGVMA4WZEVAP4FSSBWUVQKSEQ, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:52:01.708814311 (395h40m28.635109007s) [noise=true , address=104.36.82.19:4403    , piece_id=A2DCQOGRLU4SKPAFLL7RR7HRSSRH3TTPU7XIOWHO6AWOT3OWHXXA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:104.36.82.19:4403): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 20:52:01.708928322 (395h40m28.635223001s) [noise=true , address=104.36.82.44:4892    , piece_id=NARCZA3HD2V5W7UZGLDAOBZ62ZQS243R2CSXG3XGDS4JMTRREN2Q, seg_pos={0 0}, upload=316819]: Done uploading piece. err: ecclient: upload failed (node:12RHwFxcUjPsn12uHEAH3fBDJKv1v1tM8mRJXoFrZrG5djdswF5, address:104.36.82.44:4892): protocol: write tcp 159.223.143.39:57578->104.36.82.44:4892: use of closed network connection; write tcp 159.223.143.39:57578->104.36.82.44:4892: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:57578->104.36.82.44:4892: use of closed network connection
Jul  9 20:52:01.708993102 (395h40m28.635287793s) [seg_pos={0 0}, upload=316819]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul  9 20:52:01.734227352 (395h40m28.66052204s) [upload=316819]: Done uploading segments...
Jul  9 20:52:01.734255282 (395h40m28.660549975s) [upload=316819]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 10.808968394s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................]
duration:
24.049340364s
FAIL (2025-07-09 21:37:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 24.049366335s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [.........XX.................................................]
duration:
546.449871ms
FAIL (2025-07-09 21:37:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 546.478402ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)
antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................]
duration:
15.01770972s
FAIL (2025-07-09 21:37:15 UTC)
orbiter warning: 
======ERROR======
uplink: failed to upload enough pieces (needed at least 14 but got 13)
======LOGS======
upload=316819]: Done starting upload
Jul  9 20:51:01.744640664 (395h39m28.670935357s) [upload=316819]: Uploading segments...
Jul  9 20:51:01.745376443 (395h39m28.671671133s) [upload=316819]: Got next segment. Inline: false
Jul  9 20:51:01.745525760 (395h39m28.67182045s) [upload=316819]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul  9 20:51:01.745533412 (395h39m28.671828085s) [upload=316819]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul  9 20:51:01.783911087 (395h39m28.710205769s) [seg_pos={0 0}, upload=316819]: Begin upload segment...
Jul  9 20:51:01.783977239 (395h39m28.710271934s) [seg_pos={0 0}, upload=316819]: Done begin upload segment.
Jul  9 20:51:01.784009016 (395h39m28.710303716s) [noise=true , address=45.91.95.2:4009      , piece_id=WJMTOBG6FMEPZRVITBAYY2YSUEAQLYRG2VOVUVLDXJPXZ4GQQLZQ, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.784481955 (395h39m28.710776649s) [noise=true , address=77.90.31.14:4678     , piece_id=HBT23VUKCRDCJWMP5UYHAJ52UPO23PP44VXAPXR7Q73ZMORPGPPQ, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.784908723 (395h39m28.711203414s) [noise=true , address=77.90.31.11:4578     , piece_id=CTRGOFGYL5GM5LHG34IRIDUEOY6RKZ3HZORKJW7XKVRBW55ZRE3Q, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.785241082 (395h39m28.711535772s) [noise=true , address=77.90.31.17:4784     , piece_id=6NMQWGOJPBS5U76BMHCTI3RBXDHX3727ULH4US35W7IVXHAQPPQA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.785533991 (395h39m28.711828684s) [noise=true , address=77.90.31.15:4709     , piece_id=XFWO5EKOOSN6OBFIWI24F7TCRUSPMZIIN3DOEL2ERZ3VOITY773A, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.785835130 (395h39m28.71212983s) [noise=true , address=45.91.116.5:4315     , piece_id=4DU4MG7F55AV65OBOLWNZW5WPRHWPT5JDLYCS3W7P22ITVQ4ONKA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.786163209 (395h39m28.712457905s) [noise=true , address=45.91.95.4:4001      , piece_id=TMC2S53RJT4CZVVDNTXXKXOEVATBGSHCSUBU2NZLF6QWSBA7XZAQ, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.786710678 (395h39m28.713005376s) [noise=true , address=45.91.95.3:4033      , piece_id=GTYIDWLQNZDKKDTJ4WR23XUATGH2KJEO6AZOV6INJOPRNGZZY6XQ, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.787413905 (395h39m28.713708604s) [noise=true , address=104.36.82.3:4782     , piece_id=SRHJ3DNPI4ZK6NRDMCNLYJR6MIHTGVMA4WZEVAP4FSSBWUVQKSEQ, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.788027996 (395h39m28.714322693s) [noise=true , address=77.90.31.13:4632     , piece_id=4PFLEHBC46MBNEWKJYKCZ66JXTQA7H5OTRHGGEMZQ33NNAVWFUMA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.788820165 (395h39m28.715114861s) [noise=true , address=104.36.82.44:4892    , piece_id=NARCZA3HD2V5W7UZGLDAOBZ62ZQS243R2CSXG3XGDS4JMTRREN2Q, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.789282608 (395h39m28.715577305s) [noise=true , address=45.91.95.5:4012      , piece_id=K7V4QEUEO4QNA5ALS6C5R5ST5P5NXRP33MFN4X4JIBOVK7XUQZJA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.789720674 (395h39m28.716015375s) [noise=true , address=77.90.31.21:4880     , piece_id=AGTABQXZT3L2NRSSXBZT7P7OVRA5TTSK4PPXITDFHQ46BQBODGHA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.790132999 (395h39m28.716427699s) [noise=true , address=104.36.82.6:4906     , piece_id=JWKITIOBS27IKAOVSHXT4IM5EYX47UTAGHL6XANGDNK56DCPLHDA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.790759994 (395h39m28.71705469s) [noise=true , address=104.36.82.23:4464    , piece_id=REM6P63TU6YH4FQNTUIMKSL34LFEKWJR2PNY364277A23GB47DYA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.795058621 (395h39m28.721353314s) [noise=true , address=77.90.31.10:4523     , piece_id=SPWYFTHRZXVJVDII6CS2RUVLSVZOAGWKUJNCKU2VPSYRPTPEVO3Q, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.795650095 (395h39m28.721944823s) [noise=true , address=104.36.82.19:4403    , piece_id=A2DCQOGRLU4SKPAFLL7RR7HRSSRH3TTPU7XIOWHO6AWOT3OWHXXA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.798606176 (395h39m28.724900871s) [noise=true , address=77.90.31.19:4860     , piece_id=OM4TEL3C5R3N4KBHP5KRO6LBIB3LLXBCEKOEPRCSNKFT2H24FZBA, seg_pos={0 0}, upload=316819]: Uploading piece...
Jul  9 20:51:01.909993379 (395h39m28.836288058s) [upload=316819]: Next returned nil segment
Jul  9 20:51:01.910016191 (395h39m28.83631089s) [upload=316819]: Waiting for error group managing segments...
Jul  9 20:51:01.919116414 (395h39m28.845411096s) [noise=true , address=77.90.31.14:4678     , piece_id=HBT23VUKCRDCJWMP5UYHAJ52UPO23PP44VXAPXR7Q73ZMORPGPPQ, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:01.919780312 (395h39m28.846074986s) [noise=true , address=77.90.31.11:4578     , piece_id=CTRGOFGYL5GM5LHG34IRIDUEOY6RKZ3HZORKJW7XKVRBW55ZRE3Q, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:01.920354582 (395h39m28.846649276s) [noise=true , address=77.90.31.21:4880     , piece_id=AGTABQXZT3L2NRSSXBZT7P7OVRA5TTSK4PPXITDFHQ46BQBODGHA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:01.921019660 (395h39m28.847314356s) [noise=true , address=77.90.31.17:4784     , piece_id=6NMQWGOJPBS5U76BMHCTI3RBXDHX3727ULH4US35W7IVXHAQPPQA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:01.922603097 (395h39m28.848897786s) [noise=true , address=77.90.31.13:4632     , piece_id=4PFLEHBC46MBNEWKJYKCZ66JXTQA7H5OTRHGGEMZQ33NNAVWFUMA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:01.932689000 (395h39m28.858983677s) [noise=true , address=77.90.31.19:4860     , piece_id=OM4TEL3C5R3N4KBHP5KRO6LBIB3LLXBCEKOEPRCSNKFT2H24FZBA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:01.934674660 (395h39m28.86096935s) [noise=true , address=77.90.31.15:4709     , piece_id=XFWO5EKOOSN6OBFIWI24F7TCRUSPMZIIN3DOEL2ERZ3VOITY773A, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:01.936194700 (395h39m28.862489378s) [noise=true , address=77.90.31.10:4523     , piece_id=SPWYFTHRZXVJVDII6CS2RUVLSVZOAGWKUJNCKU2VPSYRPTPEVO3Q, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:02.795832904 (395h39m29.722127608s) [noise=true , address=45.91.95.2:4009      , piece_id=WJMTOBG6FMEPZRVITBAYY2YSUEAQLYRG2VOVUVLDXJPXZ4GQQLZQ, seg_pos={0 0}, upload=316819]: Done uploading piece. err: ecclient: upload failed (node:1SrEo4XQ8dBq87CWMuQvExnt7TuL9JbwXqFSehpJ6pPsCHBAi6, address:45.91.95.2:4009): protocol: storage node overloaded, request limit: 2000
Jul  9 20:51:03.997629008 (395h39m30.923923684s) [noise=true , address=45.91.95.3:4033      , piece_id=GTYIDWLQNZDKKDTJ4WR23XUATGH2KJEO6AZOV6INJOPRNGZZY6XQ, seg_pos={0 0}, upload=316819]: Done uploading piece. err: ecclient: upload failed (node:12p7yU1B5SZNrV43Fd8jJr2FSykKDV1QsVgTCNgcBMtB46DazUD, address:45.91.95.3:4033): protocol: storage node overloaded, request limit: 2000
Jul  9 20:51:04.680596617 (395h39m31.606891297s) [noise=true , address=45.91.116.5:4315     , piece_id=4DU4MG7F55AV65OBOLWNZW5WPRHWPT5JDLYCS3W7P22ITVQ4ONKA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:06.998485262 (395h39m33.924779955s) [noise=true , address=45.91.95.5:4012      , piece_id=K7V4QEUEO4QNA5ALS6C5R5ST5P5NXRP33MFN4X4JIBOVK7XUQZJA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: ecclient: upload failed (node:121sqZ4w3zPsKS2g6ufEhdqzBnZcws9558iAfpfrKxdEm6LhA5S, address:45.91.95.5:4012): protocol: storage node overloaded, request limit: 2000
Jul  9 20:51:22.922410916 (395h39m49.848705597s) [noise=true , address=104.36.82.23:4464    , piece_id=REM6P63TU6YH4FQNTUIMKSL34LFEKWJR2PNY364277A23GB47DYA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:29.420748222 (395h39m56.347042898s) [noise=true , address=45.91.95.4:4001      , piece_id=TMC2S53RJT4CZVVDNTXXKXOEVATBGSHCSUBU2NZLF6QWSBA7XZAQ, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:31.417155305 (395h39m58.343450001s) [noise=true , address=104.36.82.6:4906     , piece_id=JWKITIOBS27IKAOVSHXT4IM5EYX47UTAGHL6XANGDNK56DCPLHDA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:51:42.331922832 (395h40m9.258217513s) [noise=true , address=104.36.82.3:4782     , piece_id=SRHJ3DNPI4ZK6NRDMCNLYJR6MIHTGVMA4WZEVAP4FSSBWUVQKSEQ, seg_pos={0 0}, upload=316819]: Done uploading piece. err: <nil>
Jul  9 20:52:01.708814311 (395h40m28.635109007s) [noise=true , address=104.36.82.19:4403    , piece_id=A2DCQOGRLU4SKPAFLL7RR7HRSSRH3TTPU7XIOWHO6AWOT3OWHXXA, seg_pos={0 0}, upload=316819]: Done uploading piece. err: ecclient: upload failed (node:12SWX9WeN8GXMsV3tUyArHw4As5vKwJRzyMxPZRMug4iAY42vh4, address:104.36.82.19:4403): protocol: expected piece hash; context deadline exceeded; EOF
Jul  9 20:52:01.708928322 (395h40m28.635223001s) [noise=true , address=104.36.82.44:4892    , piece_id=NARCZA3HD2V5W7UZGLDAOBZ62ZQS243R2CSXG3XGDS4JMTRREN2Q, seg_pos={0 0}, upload=316819]: Done uploading piece. err: ecclient: upload failed (node:12RHwFxcUjPsn12uHEAH3fBDJKv1v1tM8mRJXoFrZrG5djdswF5, address:104.36.82.44:4892): protocol: write tcp 159.223.143.39:57578->104.36.82.44:4892: use of closed network connection; write tcp 159.223.143.39:57578->104.36.82.44:4892: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:57578->104.36.82.44:4892: use of closed network connection
Jul  9 20:52:01.708993102 (395h40m28.635287793s) [seg_pos={0 0}, upload=316819]: Done waiting for segment. successful: 13 optimal: 14 errs: <nil>
Jul  9 20:52:01.734227352 (395h40m28.66052204s) [upload=316819]: Done uploading segments...
Jul  9 20:52:01.734255282 (395h40m28.660549975s) [upload=316819]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 13)
Duration: 15.017737737s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [..........XX................................................]
duration:
497.734305ms
FAIL (2025-07-09 21:36:44 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 497.785877ms edge gateway us-select-1