Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 164007 reports (Page 76 of 3281)
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
23 out of 60 is failed (threshold=6) [....................................X.XXXXXXXXXXXXXXXXXXXXXX]
duration: 
1.438121664s
trace: 
https://jaeger.dev.storj.io/trace/1dc113446b9f4855
FAIL (2025-12-15 12:05:36 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 1881620CD2EC2E5A, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 11))
Duration: 1.438151852s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
24 out of 60 is failed (threshold=3) [....................................XXXXXXXXXXXXXXXXXXXXXXXX]
duration: 
3.974395487s
trace: 
https://jaeger.dev.storj.io/trace/58e28a56143fc672
FAIL (2025-12-15 12:05:11 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 188162071F525854, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 3.974423575s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
22 out of 60 is failed (threshold=6) [.....................................X.XXXXXXXXXXXXXXXXXXXXX]
duration: 
3.586454286s
trace: 
https://jaeger.dev.storj.io/trace/7d80201719fd8036
FAIL (2025-12-15 12:04:30 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 188161FD89172219, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 3.586479725s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
23 out of 60 is failed (threshold=3) [.....................................XXXXXXXXXXXXXXXXXXXXXXX]
duration: 
4.785638233s
trace: 
https://jaeger.dev.storj.io/trace/aed6efa58e9df43
FAIL (2025-12-15 12:04:02 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 188161F7011A0388, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 4.785656312s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
21 out of 60 is failed (threshold=6) [......................................X.XXXXXXXXXXXXXXXXXXXX]
duration: 
3.060355265s
trace: 
https://jaeger.dev.storj.io/trace/3b96af578ffdd786
FAIL (2025-12-15 12:03:48 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 188161F3BE31830A, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 3.060458278s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
22 out of 60 is failed (threshold=3) [......................................XXXXXXXXXXXXXXXXXXXXXX]
duration: 
2.785262628s
trace: 
https://jaeger.dev.storj.io/trace/4f991a9e174f0160
FAIL (2025-12-15 12:03:38 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 188161F16A2A7DC2, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 2.785290137s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
20 out of 60 is failed (threshold=6) [.......................................X.XXXXXXXXXXXXXXXXXXX]
duration: 
4.41195481s
trace: 
https://jaeger.dev.storj.io/trace/32f89782d034e120
FAIL (2025-12-15 12:02:59 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 188161E84526E68F, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 4.411976088s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
21 out of 60 is failed (threshold=3) [.......................................XXXXXXXXXXXXXXXXXXXXX]
duration: 
3.173635396s
trace: 
https://jaeger.dev.storj.io/trace/280ed9fd7a67abf4
FAIL (2025-12-15 12:02:59 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 188161E83903F483, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 3.17366015s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
19 out of 60 is failed (threshold=6) [........................................X.XXXXXXXXXXXXXXXXXX]
duration: 
5.000278711s
trace: 
https://jaeger.dev.storj.io/trace/7bf5f139af6f71ab
FAIL (2025-12-15 12:02:29 UTC) 
operation error S3: PutObject, request canceled, context deadline exceeded
Duration: 5.000305668s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
20 out of 60 is failed (threshold=3) [........................................XXXXXXXXXXXXXXXXXXXX]
duration: 
3.630681722s
trace: 
https://jaeger.dev.storj.io/trace/50fde7e2d9397903
FAIL (2025-12-15 12:02:20 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 188161DF2F2D5E60, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 3.630702826s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
18 out of 60 is failed (threshold=6) [.........................................X.XXXXXXXXXXXXXXXXX]
duration: 
4.061635638s
trace: 
https://jaeger.dev.storj.io/trace/72007bb8e8dcf7e
FAIL (2025-12-15 12:01:41 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 188161D638548BB1, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 4.061659107s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
19 out of 60 is failed (threshold=3) [.........................................XXXXXXXXXXXXXXXXXXX]
duration: 
1.955301435s
trace: 
https://jaeger.dev.storj.io/trace/1fae93f3e6df988c
FAIL (2025-12-15 12:01:23 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 188161D1F5991481, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 1.955334701s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
17 out of 60 is failed (threshold=6) [..........................................X.XXXXXXXXXXXXXXXX]
duration: 
4.011167056s
trace: 
https://jaeger.dev.storj.io/trace/f8d27aabb289a5c
FAIL (2025-12-15 12:01:08 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 188161CE8EA73DF5, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 4.011194599s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
18 out of 60 is failed (threshold=3) [..........................................XXXXXXXXXXXXXXXXXX]
duration: 
3.466080822s
trace: 
https://jaeger.dev.storj.io/trace/3b6fd4377110c2a6
FAIL (2025-12-15 12:00:48 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 188161C9CA4D426D, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 3.466111249s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
16 out of 60 is failed (threshold=6) [...........................................X.XXXXXXXXXXXXXXX]
duration: 
4.533897801s
trace: 
https://jaeger.dev.storj.io/trace/b02b62f2832d445
FAIL (2025-12-15 12:00:46 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 188161C954D74C36, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 4.533944665s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
15 out of 60 is failed (threshold=6) [............................................X.XXXXXXXXXXXXXX]
duration: 
3.570514965s
trace: 
https://jaeger.dev.storj.io/trace/42468d2ff14ed8ef
FAIL (2025-12-15 12:00:15 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 188161C22A81947C, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 3.570550172s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
17 out of 60 is failed (threshold=3) [...........................................XXXXXXXXXXXXXXXXX]
duration: 
2.467800654s
trace: 
https://jaeger.dev.storj.io/trace/3c24054773f18526
FAIL (2025-12-15 12:00:04 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 188161BF8086F8BA, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 2.46789061s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
14 out of 60 is failed (threshold=6) [.............................................X.XXXXXXXXXXXXX]
duration: 
4.512883643s
trace: 
https://jaeger.dev.storj.io/trace/2399afb6b6badade
FAIL (2025-12-15 11:59:25 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 188161B687E7185A, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 4.512906065s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
16 out of 60 is failed (threshold=3) [............................................XXXXXXXXXXXXXXXX]
duration: 
3.09772884s
trace: 
https://jaeger.dev.storj.io/trace/7ae94b57a32f5d5a
FAIL (2025-12-15 11:59:15 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 188161B42B3850C2, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 3.097750227s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
15 out of 60 is failed (threshold=3) [.............................................XXXXXXXXXXXXXXX]
duration: 
4.500014258s
trace: 
https://jaeger.dev.storj.io/trace/4b698da55ed53f68
FAIL (2025-12-15 11:58:29 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 188161A9725DC648, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 4.500040572s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
13 out of 60 is failed (threshold=6) [..............................................X.XXXXXXXXXXXX]
duration: 
2.971067105s
trace: 
https://jaeger.dev.storj.io/trace/28665f93d8cdfddc
FAIL (2025-12-15 11:58:24 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 188161A8521E1532, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 2.97110819s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
14 out of 60 is failed (threshold=3) [..............................................XXXXXXXXXXXXXX]
duration: 
2.90083939s
trace: 
https://jaeger.dev.storj.io/trace/14a1244c2679a595
FAIL (2025-12-15 11:58:12 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 188161A5656FAF4B, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 2.900862737s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
13 out of 60 is failed (threshold=3) [...............................................XXXXXXXXXXXXX]
duration: 
3.548343968s
trace: 
https://jaeger.dev.storj.io/trace/1225945fe40e02f8
FAIL (2025-12-15 11:57:31 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 1881619BFE5CC438, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 3.54835667s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
12 out of 60 is failed (threshold=6) [...............................................X.XXXXXXXXXXX]
duration: 
3.289344172s
trace: 
https://jaeger.dev.storj.io/trace/1d84a38029b44ff5
FAIL (2025-12-15 11:57:15 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 188161983F4FE2E8, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 3.289368595s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
12 out of 60 is failed (threshold=3) [................................................XXXXXXXXXXXX]
duration: 
5.264129008s
trace: 
https://jaeger.dev.storj.io/trace/2bdccb88101439c8
FAIL (2025-12-15 11:56:43 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 18816190E4C40D51, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 5.264151159s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
11 out of 60 is failed (threshold=6) [................................................X.XXXXXXXXXX]
duration: 
5.002369392s
trace: 
https://jaeger.dev.storj.io/trace/60d891b387030d07
FAIL (2025-12-15 11:56:16 UTC) 
operation error S3: PutObject, request canceled, context deadline exceeded
Duration: 5.00245229s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
10 out of 60 is failed (threshold=6) [.................................................X.XXXXXXXXX]
duration: 
5.001322937s
trace: 
https://jaeger.dev.storj.io/trace/271c1dd5680e61b2
FAIL (2025-12-15 11:55:42 UTC) 
operation error S3: PutObject, request canceled, context deadline exceeded
Duration: 5.001345609s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
11 out of 60 is failed (threshold=3) [.................................................XXXXXXXXXXX]
duration: 
4.716187365s
trace: 
https://jaeger.dev.storj.io/trace/21e2f58a1bdb1ab6
FAIL (2025-12-15 11:55:29 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 1881617F96F3974C, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 4.716209614s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
9 out of 60 is failed (threshold=6) [..................................................X.XXXXXXXX]
duration: 
5.001284796s
trace: 
https://jaeger.dev.storj.io/trace/3ddcf936182c9c79
FAIL (2025-12-15 11:54:58 UTC) 
operation error S3: PutObject, request canceled, context deadline exceeded
Duration: 5.001308164s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
10 out of 60 is failed (threshold=3) [..................................................XXXXXXXXXX]
duration: 
4.167632451s
trace: 
https://jaeger.dev.storj.io/trace/6a35992a1531edff
FAIL (2025-12-15 11:54:27 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 188161710DAFDF88, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 4.167668313s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
8 out of 60 is failed (threshold=6) [...................................................X.XXXXXXX]
duration: 
2.820832044s
trace: 
https://jaeger.dev.storj.io/trace/2c999fd610ec94f7
FAIL (2025-12-15 11:54:10 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 1881616D1AF48A37, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 2.820859367s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
9 out of 60 is failed (threshold=3) [...................................................XXXXXXXXX]
duration: 
4.828365331s
trace: 
https://jaeger.dev.storj.io/trace/75d16c6ba0525647
FAIL (2025-12-15 11:53:58 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 1881616A58C2B3EE, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 4.82846497s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
7 out of 60 is failed (threshold=6) [....................................................X.XXXXXX]
duration: 
2.555625984s
trace: 
https://jaeger.dev.storj.io/trace/51b051fc121bcf0b
FAIL (2025-12-15 11:53:06 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 1881615E25A61948, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 2.555642382s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
8 out of 60 is failed (threshold=3) [....................................................XXXXXXXX]
duration: 
2.772367003s
trace: 
https://jaeger.dev.storj.io/trace/10e497abc88a10e8
FAIL (2025-12-15 11:53:06 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 1881615E43591E8B, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 2.772392135s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
7 out of 60 is failed (threshold=3) [.....................................................XXXXXXX]
duration: 
3.471973748s
trace: 
https://jaeger.dev.storj.io/trace/3f832d214a2f0475
FAIL (2025-12-15 11:52:40 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 18816158422BF72E, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 3.472055509s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
6 out of 60 is failed (threshold=6) [.....................................................X.XXXXX]
duration: 
4.46770563s
trace: 
https://jaeger.dev.storj.io/trace/128042f3f6c8abf5
FAIL (2025-12-15 11:52:31 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 188161562E806513, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 4.467736017s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
6 out of 60 is failed (threshold=3) [......................................................XXXXXX]
duration: 
3.407162959s
trace: 
https://jaeger.dev.storj.io/trace/56b7e09573dcd915
FAIL (2025-12-15 11:51:59 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 1881614E97EC9BD8, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 3.407209325s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
5 out of 60 is failed (threshold=6) [......................................................X.XXXX]
duration: 
3.930781152s
trace: 
https://jaeger.dev.storj.io/trace/6a0ef3f8be063443
FAIL (2025-12-15 11:51:36 UTC) 
orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 188161494922B118, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 3.930805194s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
5 out of 60 is failed (threshold=3) [.......................................................XXXXX]
duration: 
5.930784226s
trace: 
https://jaeger.dev.storj.io/trace/fccfd4929037961
FAIL (2025-12-15 11:51:28 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 1881614784459D8F, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 5.930817388s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
4 out of 60 is failed (threshold=6) [.......................................................X.XXX]
duration: 
2.787160833s
trace: 
https://jaeger.dev.storj.io/trace/58cdb5ec8453bc24
FAIL (2025-12-15 11:50:36 UTC) 
orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 1881613B3BA59A20, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 2.787256899s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
4 out of 60 is failed (threshold=3) [........................................................XXXX]
duration: 
2.783115309s
trace: 
https://jaeger.dev.storj.io/trace/48a956946c09c203
FAIL (2025-12-15 11:50:31 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 1881613A457239B2, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 11))
Duration: 2.783206835s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
3 out of 60 is failed (threshold=6) [........................................................X.XX]
duration: 
4.560589368s
trace: 
https://jaeger.dev.storj.io/trace/4bda253a981ceed1
FAIL (2025-12-15 11:50:09 UTC) 
orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 1881613511C801C8, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 4.560695294s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
3 out of 60 is failed (threshold=3) [.........................................................XXX]
duration: 
2.11772997s
trace: 
https://jaeger.dev.storj.io/trace/73a41d0b67115b79
FAIL (2025-12-15 11:49:56 UTC) 
operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 1881613200B5B080, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 11))
Duration: 2.11783788s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
2 out of 60 is failed (threshold=3) [..........................................................XX]
duration: 
3.739468914s
trace: 
https://jaeger.dev.storj.io/trace/167144d49fc9e629
FAIL (2025-12-15 11:49:28 UTC) 
orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 1881612B9232CA7D, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 11))
Duration: 3.739569452s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
2 out of 60 is failed (threshold=6) [.........................................................X.X]
duration: 
3.019715054s
trace: 
https://jaeger.dev.storj.io/trace/34b09c35c976f88a
FAIL (2025-12-15 11:49:05 UTC) 
orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 188161262B735BEC, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 3.019741617s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
1 out of 60 is failed (threshold=6) [..........................................................X.]
duration: 
418.75227ms
trace: 
https://jaeger.dev.storj.io/trace/f6e008cef3a1e43
FAIL (2025-12-15 11:48:43 UTC) 
orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 18816116C51ABFDE, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 419.155886ms core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)
antiblip: 
1 out of 60 is failed (threshold=3) [...........................................................X]
duration: 
5.823272228s
trace: 
https://jaeger.dev.storj.io/trace/21d6dbdf15da3c73
FAIL (2025-12-15 11:48:23 UTC) 
orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 1881611C6A68916A, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 11))
Duration: 5.823298431s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
1 out of 60 is failed (threshold=6) [...........................................................X]
duration: 
1.920081818s
trace: 
https://jaeger.dev.storj.io/trace/f6e008cef3a1e43
FAIL (2025-12-15 11:47:59 UTC) 
orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 500, RequestID: 18816116C51ABFDE, HostID: , api error InternalError: We encountered an internal error, please try again.: cause(uplink: failed to upload enough pieces (needed at least 14 but got 10))
Duration: 1.920109984s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [X...........................................................]
duration: 
609.833543ms
trace: 
https://jaeger.dev.storj.io/trace/233043e29fa8c343
FAIL (2025-12-14 23:20:03 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Dec 14 22:33:46.857315921 (223h5m47.685024323s) [upload=231966]: Starting upload
Dec 14 22:33:46.857406697 (223h5m47.685115137s) [upload=231966]: Done starting upload
Dec 14 22:33:46.857554892 (223h5m47.685263291s) [upload=231966]: Uploading segments...
Dec 14 22:33:46.857789809 (223h5m47.685498211s) [upload=231966]: Got next segment. Inline: false
Dec 14 22:33:46.857854892 (223h5m47.685563283s) [upload=231966]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 14 22:33:46.857861581 (223h5m47.685569972s) [upload=231966]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 14 22:33:46.883181005 (223h5m47.710889383s) [seg_pos={0 0}, upload=231966]: Begin upload segment...
Dec 14 22:33:46.883263487 (223h5m47.710971938s) [seg_pos={0 0}, upload=231966]: Done begin upload segment.
Dec 14 22:33:46.883341357 (223h5m47.71104976s) [noise=true , address=77.90.31.19:4841     , piece_id=WGYTMINEAQY3PKMYDGTUQF7YE2TIIPLUBX5JZUN4REAWK5FSWB7A, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.884115747 (223h5m47.711824152s) [noise=true , address=145.79.227.44:4194   , piece_id=PHUUOFF3MTLVU5NFNFQWBS4VH2KRIZTETS3OONR3VTGD242J4UTQ, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.884624624 (223h5m47.712333022s) [noise=true , address=145.79.227.42:4123   , piece_id=WUZT2YMWJ57BTLL4PRAMWM5RMX4VQQPI3XRZ5XRFLAN2YN5IFCHQ, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.884680897 (223h5m47.712389298s) [noise=true , address=145.79.227.52:4445   , piece_id=TOBWVNBINBYYC2IUVBMZLEFVCC6PQ3IXCOBBT7SJZCGYERQOK2NQ, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.885186841 (223h5m47.712895238s) [noise=true , address=145.79.227.28:4725   , piece_id=IUQKFFCWXWA3LT27L3TF3MALL3QQEZUEHGDJJRD7NUDU2AAJDVFQ, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.885275901 (223h5m47.712984302s) [noise=true , address=145.79.227.40:4049   , piece_id=BJE7BEPTS54SK4TCW4O7LJM7473JX4354TAWCXI6XBSEDON3M7HQ, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.885667114 (223h5m47.713375512s) [noise=true , address=145.79.227.29:4941   , piece_id=TARVAJFNJU4ESRKSHD2QJXK6RSAPAVIML4GKPSFSOELBOO6FYQZA, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.885870007 (223h5m47.713578389s) [noise=true , address=145.79.227.51:4410   , piece_id=I7MK4JNESUDE5KHSUDSLWWNX2TKFSARSPRRYFXJCJYPKCXLYT47A, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.886162813 (223h5m47.713871216s) [noise=true , address=145.79.227.51:4409   , piece_id=V66MIUF6YEEWJ5I3A6SEDGWKXMGCLGQG5ORI7RJYKTHK44PVDARQ, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.886397673 (223h5m47.714106075s) [noise=true , address=77.90.31.16:4734     , piece_id=6TB524DIOSDWGFQMVAYE3AR65CVZ5CNMGOU2LWOFNNM6KNTNMMRA, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.886906783 (223h5m47.714615185s) [noise=true , address=145.79.227.7:4293    , piece_id=7H2C64V2NK6B44LOZAJLO3SJK3FLSVDG3OLTQ3PLNVX2FR22ATTA, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.886973316 (223h5m47.714681716s) [noise=true , address=77.90.31.13:4626     , piece_id=PRCUKRX7ENP6YKDEOIDSV4GMH5Q5K7HVC4ZNZERBDHCER2QUNV4A, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.887462068 (223h5m47.715170469s) [noise=true , address=145.79.227.39:4013   , piece_id=F55VINDA232CQRSZPY5A46SKJDZFII67SXG7PUUL57JISXEZWQWQ, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.887572123 (223h5m47.715280517s) [noise=true , address=145.79.227.50:4373   , piece_id=A7AGWKNSGUQW4QL7FZW7VA6DRPP6BSFPWE7R4M7QBBQ2XUQAPAJQ, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.887988097 (223h5m47.71569651s) [noise=true , address=77.90.31.12:4589     , piece_id=33WO7DM4OWFEMY7PMTTHVGHPPJKIVLOWFWDJC4ENOPNG4RGJVVPA, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.888041031 (223h5m47.71574943s) [noise=true , address=145.79.227.35:4481   , piece_id=6IODHBBUUA6EKJIT5XKESLSDD7J5BH7KZAHMCDI265Q6YTX22ZXQ, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.925527510 (223h5m47.753235912s) [noise=true , address=77.90.31.13:4626     , piece_id=PRCUKRX7ENP6YKDEOIDSV4GMH5Q5K7HVC4ZNZERBDHCER2QUNV4A, seg_pos={0 0}, upload=231966]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000
Dec 14 22:33:46.943379059 (223h5m47.771087459s) [noise=true , address=77.90.31.16:4734     , piece_id=6TB524DIOSDWGFQMVAYE3AR65CVZ5CNMGOU2LWOFNNM6KNTNMMRA, seg_pos={0 0}, upload=231966]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: storage node overloaded, request limit: 2000
Dec 14 22:33:46.944339095 (223h5m47.772047493s) [noise=true , address=77.90.31.12:4589     , piece_id=33WO7DM4OWFEMY7PMTTHVGHPPJKIVLOWFWDJC4ENOPNG4RGJVVPA, seg_pos={0 0}, upload=231966]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: storage node overloaded, request limit: 2000
Dec 14 22:33:46.975134078 (223h5m47.802842461s) [upload=231966]: Next returned nil segment
Dec 14 22:33:46.975152667 (223h5m47.802861058s) [upload=231966]: Waiting for error group managing segments...
Dec 14 22:33:46.984199460 (223h5m47.811907862s) [noise=true , address=145.79.227.50:4373   , piece_id=A7AGWKNSGUQW4QL7FZW7VA6DRPP6BSFPWE7R4M7QBBQ2XUQAPAJQ, seg_pos={0 0}, upload=231966]: Done uploading piece. err: <nil>
Dec 14 22:33:46.984521383 (223h5m47.812229782s) [noise=true , address=145.79.227.42:4123   , piece_id=WUZT2YMWJ57BTLL4PRAMWM5RMX4VQQPI3XRZ5XRFLAN2YN5IFCHQ, seg_pos={0 0}, upload=231966]: Done uploading piece. err: <nil>
Dec 14 22:33:46.985430877 (223h5m47.813139272s) [noise=true , address=145.79.227.39:4013   , piece_id=F55VINDA232CQRSZPY5A46SKJDZFII67SXG7PUUL57JISXEZWQWQ, seg_pos={0 0}, upload=231966]: Done uploading piece. err: <nil>
Dec 14 22:33:46.986245610 (223h5m47.813954001s) [noise=true , address=145.79.227.52:4445   , piece_id=TOBWVNBINBYYC2IUVBMZLEFVCC6PQ3IXCOBBT7SJZCGYERQOK2NQ, seg_pos={0 0}, upload=231966]: Done uploading piece. err: <nil>
Dec 14 22:33:46.987118111 (223h5m47.814826507s) [noise=true , address=145.79.227.7:4293    , piece_id=7H2C64V2NK6B44LOZAJLO3SJK3FLSVDG3OLTQ3PLNVX2FR22ATTA, seg_pos={0 0}, upload=231966]: Done uploading piece. err: <nil>
Dec 14 22:33:46.990531453 (223h5m47.81823985s) [noise=true , address=145.79.227.28:4725   , piece_id=IUQKFFCWXWA3LT27L3TF3MALL3QQEZUEHGDJJRD7NUDU2AAJDVFQ, seg_pos={0 0}, upload=231966]: Done uploading piece. err: <nil>
Dec 14 22:33:46.993914365 (223h5m47.821622758s) [noise=true , address=145.79.227.51:4410   , piece_id=I7MK4JNESUDE5KHSUDSLWWNX2TKFSARSPRRYFXJCJYPKCXLYT47A, seg_pos={0 0}, upload=231966]: Done uploading piece. err: <nil>
Dec 14 22:33:46.996262194 (223h5m47.823970588s) [noise=true , address=145.79.227.35:4481   , piece_id=6IODHBBUUA6EKJIT5XKESLSDD7J5BH7KZAHMCDI265Q6YTX22ZXQ, seg_pos={0 0}, upload=231966]: Done uploading piece. err: <nil>
Dec 14 22:33:46.998486391 (223h5m47.826194772s) [noise=true , address=145.79.227.40:4049   , piece_id=BJE7BEPTS54SK4TCW4O7LJM7473JX4354TAWCXI6XBSEDON3M7HQ, seg_pos={0 0}, upload=231966]: Done uploading piece. err: <nil>
Dec 14 22:33:46.998859134 (223h5m47.826567535s) [noise=true , address=145.79.227.51:4409   , piece_id=V66MIUF6YEEWJ5I3A6SEDGWKXMGCLGQG5ORI7RJYKTHK44PVDARQ, seg_pos={0 0}, upload=231966]: Done uploading piece. err: <nil>
Dec 14 22:33:46.999565357 (223h5m47.827273758s) [noise=true , address=145.79.227.29:4941   , piece_id=TARVAJFNJU4ESRKSHD2QJXK6RSAPAVIML4GKPSFSOELBOO6FYQZA, seg_pos={0 0}, upload=231966]: Done uploading piece. err: <nil>
Dec 14 22:33:49.527532944 (223h5m50.355241325s) [noise=true , address=145.79.227.44:4194   , piece_id=PHUUOFF3MTLVU5NFNFQWBS4VH2KRIZTETS3OONR3VTGD242J4UTQ, seg_pos={0 0}, upload=231966]: Done uploading piece. err: <nil>
Dec 14 22:34:16.824339067 (223h6m17.652047462s) [noise=true , address=77.90.31.19:4841     , piece_id=WGYTMINEAQY3PKMYDGTUQF7YE2TIIPLUBX5JZUN4REAWK5FSWB7A, seg_pos={0 0}, upload=231966]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 159.223.143.39:57630->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 14 22:34:16.824378696 (223h6m17.652087081s) [seg_pos={0 0}, upload=231966]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Dec 14 22:34:16.843102183 (223h6m17.670810563s) [upload=231966]: Done uploading segments...
Dec 14 22:34:16.843158344 (223h6m17.670866733s) [upload=231966]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 609.942449ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.X..........................................................]
duration: 
606.519778ms
trace: 
https://jaeger.dev.storj.io/trace/233043e29fa8c343
FAIL (2025-12-14 23:19:44 UTC) 
orbiter warning: 
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
Dec 14 22:33:46.857315921 (223h5m47.685024323s) [upload=231966]: Starting upload
Dec 14 22:33:46.857406697 (223h5m47.685115137s) [upload=231966]: Done starting upload
Dec 14 22:33:46.857554892 (223h5m47.685263291s) [upload=231966]: Uploading segments...
Dec 14 22:33:46.857789809 (223h5m47.685498211s) [upload=231966]: Got next segment. Inline: false
Dec 14 22:33:46.857854892 (223h5m47.685563283s) [upload=231966]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 14 22:33:46.857861581 (223h5m47.685569972s) [upload=231966]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 14 22:33:46.883181005 (223h5m47.710889383s) [seg_pos={0 0}, upload=231966]: Begin upload segment...
Dec 14 22:33:46.883263487 (223h5m47.710971938s) [seg_pos={0 0}, upload=231966]: Done begin upload segment.
Dec 14 22:33:46.883341357 (223h5m47.71104976s) [noise=true , address=77.90.31.19:4841     , piece_id=WGYTMINEAQY3PKMYDGTUQF7YE2TIIPLUBX5JZUN4REAWK5FSWB7A, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.884115747 (223h5m47.711824152s) [noise=true , address=145.79.227.44:4194   , piece_id=PHUUOFF3MTLVU5NFNFQWBS4VH2KRIZTETS3OONR3VTGD242J4UTQ, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.884624624 (223h5m47.712333022s) [noise=true , address=145.79.227.42:4123   , piece_id=WUZT2YMWJ57BTLL4PRAMWM5RMX4VQQPI3XRZ5XRFLAN2YN5IFCHQ, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.884680897 (223h5m47.712389298s) [noise=true , address=145.79.227.52:4445   , piece_id=TOBWVNBINBYYC2IUVBMZLEFVCC6PQ3IXCOBBT7SJZCGYERQOK2NQ, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.885186841 (223h5m47.712895238s) [noise=true , address=145.79.227.28:4725   , piece_id=IUQKFFCWXWA3LT27L3TF3MALL3QQEZUEHGDJJRD7NUDU2AAJDVFQ, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.885275901 (223h5m47.712984302s) [noise=true , address=145.79.227.40:4049   , piece_id=BJE7BEPTS54SK4TCW4O7LJM7473JX4354TAWCXI6XBSEDON3M7HQ, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.885667114 (223h5m47.713375512s) [noise=true , address=145.79.227.29:4941   , piece_id=TARVAJFNJU4ESRKSHD2QJXK6RSAPAVIML4GKPSFSOELBOO6FYQZA, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.885870007 (223h5m47.713578389s) [noise=true , address=145.79.227.51:4410   , piece_id=I7MK4JNESUDE5KHSUDSLWWNX2TKFSARSPRRYFXJCJYPKCXLYT47A, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.886162813 (223h5m47.713871216s) [noise=true , address=145.79.227.51:4409   , piece_id=V66MIUF6YEEWJ5I3A6SEDGWKXMGCLGQG5ORI7RJYKTHK44PVDARQ, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.886397673 (223h5m47.714106075s) [noise=true , address=77.90.31.16:4734     , piece_id=6TB524DIOSDWGFQMVAYE3AR65CVZ5CNMGOU2LWOFNNM6KNTNMMRA, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.886906783 (223h5m47.714615185s) [noise=true , address=145.79.227.7:4293    , piece_id=7H2C64V2NK6B44LOZAJLO3SJK3FLSVDG3OLTQ3PLNVX2FR22ATTA, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.886973316 (223h5m47.714681716s) [noise=true , address=77.90.31.13:4626     , piece_id=PRCUKRX7ENP6YKDEOIDSV4GMH5Q5K7HVC4ZNZERBDHCER2QUNV4A, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.887462068 (223h5m47.715170469s) [noise=true , address=145.79.227.39:4013   , piece_id=F55VINDA232CQRSZPY5A46SKJDZFII67SXG7PUUL57JISXEZWQWQ, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.887572123 (223h5m47.715280517s) [noise=true , address=145.79.227.50:4373   , piece_id=A7AGWKNSGUQW4QL7FZW7VA6DRPP6BSFPWE7R4M7QBBQ2XUQAPAJQ, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.887988097 (223h5m47.71569651s) [noise=true , address=77.90.31.12:4589     , piece_id=33WO7DM4OWFEMY7PMTTHVGHPPJKIVLOWFWDJC4ENOPNG4RGJVVPA, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.888041031 (223h5m47.71574943s) [noise=true , address=145.79.227.35:4481   , piece_id=6IODHBBUUA6EKJIT5XKESLSDD7J5BH7KZAHMCDI265Q6YTX22ZXQ, seg_pos={0 0}, upload=231966]: Uploading piece...
Dec 14 22:33:46.925527510 (223h5m47.753235912s) [noise=true , address=77.90.31.13:4626     , piece_id=PRCUKRX7ENP6YKDEOIDSV4GMH5Q5K7HVC4ZNZERBDHCER2QUNV4A, seg_pos={0 0}, upload=231966]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: storage node overloaded, request limit: 2000
Dec 14 22:33:46.943379059 (223h5m47.771087459s) [noise=true , address=77.90.31.16:4734     , piece_id=6TB524DIOSDWGFQMVAYE3AR65CVZ5CNMGOU2LWOFNNM6KNTNMMRA, seg_pos={0 0}, upload=231966]: Done uploading piece. err: ecclient: upload failed (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9, address:77.90.31.16:4734): protocol: storage node overloaded, request limit: 2000
Dec 14 22:33:46.944339095 (223h5m47.772047493s) [noise=true , address=77.90.31.12:4589     , piece_id=33WO7DM4OWFEMY7PMTTHVGHPPJKIVLOWFWDJC4ENOPNG4RGJVVPA, seg_pos={0 0}, upload=231966]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: storage node overloaded, request limit: 2000
Dec 14 22:33:46.975134078 (223h5m47.802842461s) [upload=231966]: Next returned nil segment
Dec 14 22:33:46.975152667 (223h5m47.802861058s) [upload=231966]: Waiting for error group managing segments...
Dec 14 22:33:46.984199460 (223h5m47.811907862s) [noise=true , address=145.79.227.50:4373   , piece_id=A7AGWKNSGUQW4QL7FZW7VA6DRPP6BSFPWE7R4M7QBBQ2XUQAPAJQ, seg_pos={0 0}, upload=231966]: Done uploading piece. err: <nil>
Dec 14 22:33:46.984521383 (223h5m47.812229782s) [noise=true , address=145.79.227.42:4123   , piece_id=WUZT2YMWJ57BTLL4PRAMWM5RMX4VQQPI3XRZ5XRFLAN2YN5IFCHQ, seg_pos={0 0}, upload=231966]: Done uploading piece. err: <nil>
Dec 14 22:33:46.985430877 (223h5m47.813139272s) [noise=true , address=145.79.227.39:4013   , piece_id=F55VINDA232CQRSZPY5A46SKJDZFII67SXG7PUUL57JISXEZWQWQ, seg_pos={0 0}, upload=231966]: Done uploading piece. err: <nil>
Dec 14 22:33:46.986245610 (223h5m47.813954001s) [noise=true , address=145.79.227.52:4445   , piece_id=TOBWVNBINBYYC2IUVBMZLEFVCC6PQ3IXCOBBT7SJZCGYERQOK2NQ, seg_pos={0 0}, upload=231966]: Done uploading piece. err: <nil>
Dec 14 22:33:46.987118111 (223h5m47.814826507s) [noise=true , address=145.79.227.7:4293    , piece_id=7H2C64V2NK6B44LOZAJLO3SJK3FLSVDG3OLTQ3PLNVX2FR22ATTA, seg_pos={0 0}, upload=231966]: Done uploading piece. err: <nil>
Dec 14 22:33:46.990531453 (223h5m47.81823985s) [noise=true , address=145.79.227.28:4725   , piece_id=IUQKFFCWXWA3LT27L3TF3MALL3QQEZUEHGDJJRD7NUDU2AAJDVFQ, seg_pos={0 0}, upload=231966]: Done uploading piece. err: <nil>
Dec 14 22:33:46.993914365 (223h5m47.821622758s) [noise=true , address=145.79.227.51:4410   , piece_id=I7MK4JNESUDE5KHSUDSLWWNX2TKFSARSPRRYFXJCJYPKCXLYT47A, seg_pos={0 0}, upload=231966]: Done uploading piece. err: <nil>
Dec 14 22:33:46.996262194 (223h5m47.823970588s) [noise=true , address=145.79.227.35:4481   , piece_id=6IODHBBUUA6EKJIT5XKESLSDD7J5BH7KZAHMCDI265Q6YTX22ZXQ, seg_pos={0 0}, upload=231966]: Done uploading piece. err: <nil>
Dec 14 22:33:46.998486391 (223h5m47.826194772s) [noise=true , address=145.79.227.40:4049   , piece_id=BJE7BEPTS54SK4TCW4O7LJM7473JX4354TAWCXI6XBSEDON3M7HQ, seg_pos={0 0}, upload=231966]: Done uploading piece. err: <nil>
Dec 14 22:33:46.998859134 (223h5m47.826567535s) [noise=true , address=145.79.227.51:4409   , piece_id=V66MIUF6YEEWJ5I3A6SEDGWKXMGCLGQG5ORI7RJYKTHK44PVDARQ, seg_pos={0 0}, upload=231966]: Done uploading piece. err: <nil>
Dec 14 22:33:46.999565357 (223h5m47.827273758s) [noise=true , address=145.79.227.29:4941   , piece_id=TARVAJFNJU4ESRKSHD2QJXK6RSAPAVIML4GKPSFSOELBOO6FYQZA, seg_pos={0 0}, upload=231966]: Done uploading piece. err: <nil>
Dec 14 22:33:49.527532944 (223h5m50.355241325s) [noise=true , address=145.79.227.44:4194   , piece_id=PHUUOFF3MTLVU5NFNFQWBS4VH2KRIZTETS3OONR3VTGD242J4UTQ, seg_pos={0 0}, upload=231966]: Done uploading piece. err: <nil>
Dec 14 22:34:16.824339067 (223h6m17.652047462s) [noise=true , address=77.90.31.19:4841     , piece_id=WGYTMINEAQY3PKMYDGTUQF7YE2TIIPLUBX5JZUN4REAWK5FSWB7A, seg_pos={0 0}, upload=231966]: Done uploading piece. err: ecclient: upload failed (node:1EZTRkB6M2F4mwRbYSvsv3ybGk1Gz225pDd18RNBk1xe1SFdGA, address:77.90.31.19:4841): protocol: write tcp 159.223.143.39:57630->77.90.31.19:4841: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Dec 14 22:34:16.824378696 (223h6m17.652087081s) [seg_pos={0 0}, upload=231966]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Dec 14 22:34:16.843102183 (223h6m17.670810563s) [upload=231966]: Done uploading segments...
Dec 14 22:34:16.843158344 (223h6m17.670866733s) [upload=231966]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 606.547348ms core uplink us-select-1