Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
5.389066296s
FAIL (2025-07-20 17:17:33 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.389094963s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
5.242691364s
FAIL (2025-07-20 17:16:28 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.242721961s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
6.971291742s
FAIL (2025-07-20 17:15:43 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 6.971322391s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
5.495479095s
FAIL (2025-07-20 17:15:20 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 5.495524788s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
4.780164606s
FAIL (2025-07-20 17:14:10 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 4.780193754s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
4.811336917s
FAIL (2025-07-20 17:13:04 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 4.811368795s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
4.632776739s
FAIL (2025-07-20 17:12:29 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 4.632802172s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
4.466873805s
FAIL (2025-07-20 17:11:59 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 4.466906463s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
4.531601127s
FAIL (2025-07-20 17:11:24 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 4.531626616s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
4.466694209s
FAIL (2025-07-20 17:10:33 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 4.466724602s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
4.578600212s
FAIL (2025-07-20 17:09:43 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 4.578623221s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
4.623136892s
FAIL (2025-07-20 17:09:07 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 4.623161864s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
4.765427409s
FAIL (2025-07-20 17:08:42 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 4.765464522s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
4.682831986s
FAIL (2025-07-20 17:08:05 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 4.682930212s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
4.498347642s
FAIL (2025-07-20 17:07:28 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 4.498409527s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
4.559054417s
FAIL (2025-07-20 17:06:22 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 4.559085897s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
4.437982179s
FAIL (2025-07-20 17:05:17 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 4.438013945s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
4.601688019s
FAIL (2025-07-20 17:04:48 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 4.60176574s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
4.666126823s
FAIL (2025-07-20 17:03:52 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 4.666173639s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
4.558679211s
FAIL (2025-07-20 17:03:09 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 4.55871156s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
4.637256357s
FAIL (2025-07-20 17:02:33 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 4.637286369s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
4.606965408s
FAIL (2025-07-20 17:02:07 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 4.60699904s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
4.599270589s
FAIL (2025-07-20 17:01:06 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 4.599299837s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
4.577389996s
FAIL (2025-07-20 17:00:28 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 4.577484176s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
4.592388253s
FAIL (2025-07-20 16:59:45 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 4.592418332s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
4.522588813s
FAIL (2025-07-20 16:58:40 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 4.522619655s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
4.614729796s
FAIL (2025-07-20 16:58:13 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 4.61475938s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
4.649524902s
FAIL (2025-07-20 16:57:17 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 4.649554283s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
4.725507709s
FAIL (2025-07-20 16:56:32 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 4.725566287s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
4.636480086s
FAIL (2025-07-20 16:56:04 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 4.636515175s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
4.479610391s
FAIL (2025-07-20 16:54:55 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 4.479644336s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
4.474126641s
FAIL (2025-07-20 16:53:58 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 4.474160447s
core
uplink
ap1
|
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
38.570481662s
FAIL (2025-07-20 16:53:20 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 38.570537108s
core
uplink
ap1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
405.510415ms
FAIL (2025-07-19 16:58:06 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
JAS3NAEHPQ, seg_pos={0 0}, upload=13805]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF
Jul 19 16:10:50.664428623 (17h20m32.513035707s) [seg_pos={0 0}, upload=13805]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:10:50.664509198 (17h20m32.513116285s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:10:50.664514760 (17h20m32.513121827s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:10:50.736789321 (17h20m32.585396411s) [upload=13805]: Done uploading segments...
Jul 19 16:10:50.736826215 (17h20m32.585433295s) [upload=13805]: Upload finished. err: <nil>
Jul 19 16:11:58.314006398 (17h21m40.162613482s) [upload=13817]: Starting upload
Jul 19 16:11:58.314749584 (17h21m40.16335667s) [upload=13817]: Done starting upload
Jul 19 16:11:58.315040835 (17h21m40.163647924s) [upload=13817]: Uploading segments...
Jul 19 16:11:58.315354232 (17h21m40.16396132s) [upload=13817]: Got next segment. Inline: false
Jul 19 16:11:58.315426816 (17h21m40.164033905s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 16:11:58.315434002 (17h21m40.164041082s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 16:11:58.349934256 (17h21m40.198541338s) [seg_pos={0 0}, upload=13817]: Begin upload segment...
Jul 19 16:11:58.349982513 (17h21m40.198589598s) [seg_pos={0 0}, upload=13817]: Done begin upload segment.
Jul 19 16:11:58.350018513 (17h21m40.198625595s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350588007 (17h21m40.199195095s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350804146 (17h21m40.199411237s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351514170 (17h21m40.200121264s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351771227 (17h21m40.200378315s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352670435 (17h21m40.20127752s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352723228 (17h21m40.201330314s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.353502192 (17h21m40.202109274s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.354132630 (17h21m40.202739715s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.356556981 (17h21m40.205164061s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.357776003 (17h21m40.206383088s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.360436506 (17h21m40.209043598s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.362556012 (17h21m40.211163105s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.365515091 (17h21m40.214122216s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.383635044 (17h21m40.232242128s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.384662269 (17h21m40.233269351s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.476689441 (17h21m40.325296511s) [upload=13817]: Next returned nil segment
Jul 19 16:11:58.476708926 (17h21m40.325315996s) [upload=13817]: Waiting for error group managing segments...
Jul 19 16:11:58.480780753 (17h21m40.329387833s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.482043942 (17h21m40.330651012s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.484678573 (17h21m40.333285658s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485257307 (17h21m40.333864389s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485858320 (17h21m40.334465402s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486366983 (17h21m40.334974063s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486892050 (17h21m40.335499132s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487479760 (17h21m40.336086842s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487681707 (17h21m40.336288776s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488328759 (17h21m40.336935845s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488375781 (17h21m40.336982854s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488895257 (17h21m40.33750234s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495361446 (17h21m40.34396853s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495390833 (17h21m40.343997919s) [seg_pos={0 0}, upload=13817]: Segment reached optimal threshold of 13 pieces.
Jul 19 16:11:58.495569782 (17h21m40.344176865s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495654740 (17h21m40.344261935s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495872315 (17h21m40.344479403s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection
Jul 19 16:11:58.495925334 (17h21m40.34453242s) [seg_pos={0 0}, upload=13817]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:11:58.496062793 (17h21m40.344669888s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:11:58.496071020 (17h21m40.344678104s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:11:58.547447138 (17h21m40.396054224s) [upload=13817]: Done uploading segments...
Jul 19 16:11:58.547468806 (17h21m40.39607588s) [upload=13817]: Upload finished. err: <nil>
Duration: 405.537639ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
466.462465ms
FAIL (2025-07-19 16:57:48 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
JAS3NAEHPQ, seg_pos={0 0}, upload=13805]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF
Jul 19 16:10:50.664428623 (17h20m32.513035707s) [seg_pos={0 0}, upload=13805]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:10:50.664509198 (17h20m32.513116285s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:10:50.664514760 (17h20m32.513121827s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:10:50.736789321 (17h20m32.585396411s) [upload=13805]: Done uploading segments...
Jul 19 16:10:50.736826215 (17h20m32.585433295s) [upload=13805]: Upload finished. err: <nil>
Jul 19 16:11:58.314006398 (17h21m40.162613482s) [upload=13817]: Starting upload
Jul 19 16:11:58.314749584 (17h21m40.16335667s) [upload=13817]: Done starting upload
Jul 19 16:11:58.315040835 (17h21m40.163647924s) [upload=13817]: Uploading segments...
Jul 19 16:11:58.315354232 (17h21m40.16396132s) [upload=13817]: Got next segment. Inline: false
Jul 19 16:11:58.315426816 (17h21m40.164033905s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 16:11:58.315434002 (17h21m40.164041082s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 16:11:58.349934256 (17h21m40.198541338s) [seg_pos={0 0}, upload=13817]: Begin upload segment...
Jul 19 16:11:58.349982513 (17h21m40.198589598s) [seg_pos={0 0}, upload=13817]: Done begin upload segment.
Jul 19 16:11:58.350018513 (17h21m40.198625595s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350588007 (17h21m40.199195095s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350804146 (17h21m40.199411237s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351514170 (17h21m40.200121264s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351771227 (17h21m40.200378315s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352670435 (17h21m40.20127752s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352723228 (17h21m40.201330314s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.353502192 (17h21m40.202109274s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.354132630 (17h21m40.202739715s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.356556981 (17h21m40.205164061s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.357776003 (17h21m40.206383088s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.360436506 (17h21m40.209043598s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.362556012 (17h21m40.211163105s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.365515091 (17h21m40.214122216s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.383635044 (17h21m40.232242128s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.384662269 (17h21m40.233269351s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.476689441 (17h21m40.325296511s) [upload=13817]: Next returned nil segment
Jul 19 16:11:58.476708926 (17h21m40.325315996s) [upload=13817]: Waiting for error group managing segments...
Jul 19 16:11:58.480780753 (17h21m40.329387833s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.482043942 (17h21m40.330651012s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.484678573 (17h21m40.333285658s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485257307 (17h21m40.333864389s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485858320 (17h21m40.334465402s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486366983 (17h21m40.334974063s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486892050 (17h21m40.335499132s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487479760 (17h21m40.336086842s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487681707 (17h21m40.336288776s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488328759 (17h21m40.336935845s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488375781 (17h21m40.336982854s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488895257 (17h21m40.33750234s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495361446 (17h21m40.34396853s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495390833 (17h21m40.343997919s) [seg_pos={0 0}, upload=13817]: Segment reached optimal threshold of 13 pieces.
Jul 19 16:11:58.495569782 (17h21m40.344176865s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495654740 (17h21m40.344261935s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495872315 (17h21m40.344479403s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection
Jul 19 16:11:58.495925334 (17h21m40.34453242s) [seg_pos={0 0}, upload=13817]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:11:58.496062793 (17h21m40.344669888s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:11:58.496071020 (17h21m40.344678104s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:11:58.547447138 (17h21m40.396054224s) [upload=13817]: Done uploading segments...
Jul 19 16:11:58.547468806 (17h21m40.39607588s) [upload=13817]: Upload finished. err: <nil>
Duration: 466.49221ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
419.644296ms
FAIL (2025-07-19 16:57:25 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
JAS3NAEHPQ, seg_pos={0 0}, upload=13805]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF
Jul 19 16:10:50.664428623 (17h20m32.513035707s) [seg_pos={0 0}, upload=13805]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:10:50.664509198 (17h20m32.513116285s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:10:50.664514760 (17h20m32.513121827s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:10:50.736789321 (17h20m32.585396411s) [upload=13805]: Done uploading segments...
Jul 19 16:10:50.736826215 (17h20m32.585433295s) [upload=13805]: Upload finished. err: <nil>
Jul 19 16:11:58.314006398 (17h21m40.162613482s) [upload=13817]: Starting upload
Jul 19 16:11:58.314749584 (17h21m40.16335667s) [upload=13817]: Done starting upload
Jul 19 16:11:58.315040835 (17h21m40.163647924s) [upload=13817]: Uploading segments...
Jul 19 16:11:58.315354232 (17h21m40.16396132s) [upload=13817]: Got next segment. Inline: false
Jul 19 16:11:58.315426816 (17h21m40.164033905s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 16:11:58.315434002 (17h21m40.164041082s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 16:11:58.349934256 (17h21m40.198541338s) [seg_pos={0 0}, upload=13817]: Begin upload segment...
Jul 19 16:11:58.349982513 (17h21m40.198589598s) [seg_pos={0 0}, upload=13817]: Done begin upload segment.
Jul 19 16:11:58.350018513 (17h21m40.198625595s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350588007 (17h21m40.199195095s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350804146 (17h21m40.199411237s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351514170 (17h21m40.200121264s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351771227 (17h21m40.200378315s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352670435 (17h21m40.20127752s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352723228 (17h21m40.201330314s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.353502192 (17h21m40.202109274s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.354132630 (17h21m40.202739715s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.356556981 (17h21m40.205164061s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.357776003 (17h21m40.206383088s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.360436506 (17h21m40.209043598s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.362556012 (17h21m40.211163105s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.365515091 (17h21m40.214122216s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.383635044 (17h21m40.232242128s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.384662269 (17h21m40.233269351s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.476689441 (17h21m40.325296511s) [upload=13817]: Next returned nil segment
Jul 19 16:11:58.476708926 (17h21m40.325315996s) [upload=13817]: Waiting for error group managing segments...
Jul 19 16:11:58.480780753 (17h21m40.329387833s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.482043942 (17h21m40.330651012s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.484678573 (17h21m40.333285658s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485257307 (17h21m40.333864389s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485858320 (17h21m40.334465402s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486366983 (17h21m40.334974063s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486892050 (17h21m40.335499132s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487479760 (17h21m40.336086842s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487681707 (17h21m40.336288776s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488328759 (17h21m40.336935845s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488375781 (17h21m40.336982854s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488895257 (17h21m40.33750234s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495361446 (17h21m40.34396853s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495390833 (17h21m40.343997919s) [seg_pos={0 0}, upload=13817]: Segment reached optimal threshold of 13 pieces.
Jul 19 16:11:58.495569782 (17h21m40.344176865s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495654740 (17h21m40.344261935s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495872315 (17h21m40.344479403s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection
Jul 19 16:11:58.495925334 (17h21m40.34453242s) [seg_pos={0 0}, upload=13817]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:11:58.496062793 (17h21m40.344669888s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:11:58.496071020 (17h21m40.344678104s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:11:58.547447138 (17h21m40.396054224s) [upload=13817]: Done uploading segments...
Jul 19 16:11:58.547468806 (17h21m40.39607588s) [upload=13817]: Upload finished. err: <nil>
Duration: 419.675429ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
466.585299ms
FAIL (2025-07-19 16:56:58 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
JAS3NAEHPQ, seg_pos={0 0}, upload=13805]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF
Jul 19 16:10:50.664428623 (17h20m32.513035707s) [seg_pos={0 0}, upload=13805]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:10:50.664509198 (17h20m32.513116285s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:10:50.664514760 (17h20m32.513121827s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:10:50.736789321 (17h20m32.585396411s) [upload=13805]: Done uploading segments...
Jul 19 16:10:50.736826215 (17h20m32.585433295s) [upload=13805]: Upload finished. err: <nil>
Jul 19 16:11:58.314006398 (17h21m40.162613482s) [upload=13817]: Starting upload
Jul 19 16:11:58.314749584 (17h21m40.16335667s) [upload=13817]: Done starting upload
Jul 19 16:11:58.315040835 (17h21m40.163647924s) [upload=13817]: Uploading segments...
Jul 19 16:11:58.315354232 (17h21m40.16396132s) [upload=13817]: Got next segment. Inline: false
Jul 19 16:11:58.315426816 (17h21m40.164033905s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 16:11:58.315434002 (17h21m40.164041082s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 16:11:58.349934256 (17h21m40.198541338s) [seg_pos={0 0}, upload=13817]: Begin upload segment...
Jul 19 16:11:58.349982513 (17h21m40.198589598s) [seg_pos={0 0}, upload=13817]: Done begin upload segment.
Jul 19 16:11:58.350018513 (17h21m40.198625595s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350588007 (17h21m40.199195095s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350804146 (17h21m40.199411237s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351514170 (17h21m40.200121264s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351771227 (17h21m40.200378315s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352670435 (17h21m40.20127752s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352723228 (17h21m40.201330314s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.353502192 (17h21m40.202109274s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.354132630 (17h21m40.202739715s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.356556981 (17h21m40.205164061s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.357776003 (17h21m40.206383088s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.360436506 (17h21m40.209043598s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.362556012 (17h21m40.211163105s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.365515091 (17h21m40.214122216s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.383635044 (17h21m40.232242128s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.384662269 (17h21m40.233269351s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.476689441 (17h21m40.325296511s) [upload=13817]: Next returned nil segment
Jul 19 16:11:58.476708926 (17h21m40.325315996s) [upload=13817]: Waiting for error group managing segments...
Jul 19 16:11:58.480780753 (17h21m40.329387833s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.482043942 (17h21m40.330651012s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.484678573 (17h21m40.333285658s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485257307 (17h21m40.333864389s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485858320 (17h21m40.334465402s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486366983 (17h21m40.334974063s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486892050 (17h21m40.335499132s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487479760 (17h21m40.336086842s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487681707 (17h21m40.336288776s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488328759 (17h21m40.336935845s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488375781 (17h21m40.336982854s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488895257 (17h21m40.33750234s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495361446 (17h21m40.34396853s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495390833 (17h21m40.343997919s) [seg_pos={0 0}, upload=13817]: Segment reached optimal threshold of 13 pieces.
Jul 19 16:11:58.495569782 (17h21m40.344176865s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495654740 (17h21m40.344261935s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495872315 (17h21m40.344479403s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection
Jul 19 16:11:58.495925334 (17h21m40.34453242s) [seg_pos={0 0}, upload=13817]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:11:58.496062793 (17h21m40.344669888s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:11:58.496071020 (17h21m40.344678104s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:11:58.547447138 (17h21m40.396054224s) [upload=13817]: Done uploading segments...
Jul 19 16:11:58.547468806 (17h21m40.39607588s) [upload=13817]: Upload finished. err: <nil>
Duration: 466.702905ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
868.603743ms
FAIL (2025-07-19 16:56:03 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
JAS3NAEHPQ, seg_pos={0 0}, upload=13805]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF
Jul 19 16:10:50.664428623 (17h20m32.513035707s) [seg_pos={0 0}, upload=13805]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:10:50.664509198 (17h20m32.513116285s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:10:50.664514760 (17h20m32.513121827s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:10:50.736789321 (17h20m32.585396411s) [upload=13805]: Done uploading segments...
Jul 19 16:10:50.736826215 (17h20m32.585433295s) [upload=13805]: Upload finished. err: <nil>
Jul 19 16:11:58.314006398 (17h21m40.162613482s) [upload=13817]: Starting upload
Jul 19 16:11:58.314749584 (17h21m40.16335667s) [upload=13817]: Done starting upload
Jul 19 16:11:58.315040835 (17h21m40.163647924s) [upload=13817]: Uploading segments...
Jul 19 16:11:58.315354232 (17h21m40.16396132s) [upload=13817]: Got next segment. Inline: false
Jul 19 16:11:58.315426816 (17h21m40.164033905s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 16:11:58.315434002 (17h21m40.164041082s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 16:11:58.349934256 (17h21m40.198541338s) [seg_pos={0 0}, upload=13817]: Begin upload segment...
Jul 19 16:11:58.349982513 (17h21m40.198589598s) [seg_pos={0 0}, upload=13817]: Done begin upload segment.
Jul 19 16:11:58.350018513 (17h21m40.198625595s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350588007 (17h21m40.199195095s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350804146 (17h21m40.199411237s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351514170 (17h21m40.200121264s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351771227 (17h21m40.200378315s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352670435 (17h21m40.20127752s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352723228 (17h21m40.201330314s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.353502192 (17h21m40.202109274s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.354132630 (17h21m40.202739715s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.356556981 (17h21m40.205164061s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.357776003 (17h21m40.206383088s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.360436506 (17h21m40.209043598s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.362556012 (17h21m40.211163105s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.365515091 (17h21m40.214122216s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.383635044 (17h21m40.232242128s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.384662269 (17h21m40.233269351s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.476689441 (17h21m40.325296511s) [upload=13817]: Next returned nil segment
Jul 19 16:11:58.476708926 (17h21m40.325315996s) [upload=13817]: Waiting for error group managing segments...
Jul 19 16:11:58.480780753 (17h21m40.329387833s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.482043942 (17h21m40.330651012s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.484678573 (17h21m40.333285658s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485257307 (17h21m40.333864389s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485858320 (17h21m40.334465402s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486366983 (17h21m40.334974063s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486892050 (17h21m40.335499132s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487479760 (17h21m40.336086842s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487681707 (17h21m40.336288776s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488328759 (17h21m40.336935845s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488375781 (17h21m40.336982854s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488895257 (17h21m40.33750234s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495361446 (17h21m40.34396853s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495390833 (17h21m40.343997919s) [seg_pos={0 0}, upload=13817]: Segment reached optimal threshold of 13 pieces.
Jul 19 16:11:58.495569782 (17h21m40.344176865s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495654740 (17h21m40.344261935s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495872315 (17h21m40.344479403s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection
Jul 19 16:11:58.495925334 (17h21m40.34453242s) [seg_pos={0 0}, upload=13817]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:11:58.496062793 (17h21m40.344669888s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:11:58.496071020 (17h21m40.344678104s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:11:58.547447138 (17h21m40.396054224s) [upload=13817]: Done uploading segments...
Jul 19 16:11:58.547468806 (17h21m40.39607588s) [upload=13817]: Upload finished. err: <nil>
Duration: 868.656739ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
492.229526ms
FAIL (2025-07-19 16:55:04 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
JAS3NAEHPQ, seg_pos={0 0}, upload=13805]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF
Jul 19 16:10:50.664428623 (17h20m32.513035707s) [seg_pos={0 0}, upload=13805]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:10:50.664509198 (17h20m32.513116285s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:10:50.664514760 (17h20m32.513121827s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:10:50.736789321 (17h20m32.585396411s) [upload=13805]: Done uploading segments...
Jul 19 16:10:50.736826215 (17h20m32.585433295s) [upload=13805]: Upload finished. err: <nil>
Jul 19 16:11:58.314006398 (17h21m40.162613482s) [upload=13817]: Starting upload
Jul 19 16:11:58.314749584 (17h21m40.16335667s) [upload=13817]: Done starting upload
Jul 19 16:11:58.315040835 (17h21m40.163647924s) [upload=13817]: Uploading segments...
Jul 19 16:11:58.315354232 (17h21m40.16396132s) [upload=13817]: Got next segment. Inline: false
Jul 19 16:11:58.315426816 (17h21m40.164033905s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 16:11:58.315434002 (17h21m40.164041082s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 16:11:58.349934256 (17h21m40.198541338s) [seg_pos={0 0}, upload=13817]: Begin upload segment...
Jul 19 16:11:58.349982513 (17h21m40.198589598s) [seg_pos={0 0}, upload=13817]: Done begin upload segment.
Jul 19 16:11:58.350018513 (17h21m40.198625595s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350588007 (17h21m40.199195095s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350804146 (17h21m40.199411237s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351514170 (17h21m40.200121264s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351771227 (17h21m40.200378315s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352670435 (17h21m40.20127752s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352723228 (17h21m40.201330314s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.353502192 (17h21m40.202109274s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.354132630 (17h21m40.202739715s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.356556981 (17h21m40.205164061s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.357776003 (17h21m40.206383088s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.360436506 (17h21m40.209043598s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.362556012 (17h21m40.211163105s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.365515091 (17h21m40.214122216s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.383635044 (17h21m40.232242128s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.384662269 (17h21m40.233269351s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.476689441 (17h21m40.325296511s) [upload=13817]: Next returned nil segment
Jul 19 16:11:58.476708926 (17h21m40.325315996s) [upload=13817]: Waiting for error group managing segments...
Jul 19 16:11:58.480780753 (17h21m40.329387833s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.482043942 (17h21m40.330651012s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.484678573 (17h21m40.333285658s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485257307 (17h21m40.333864389s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485858320 (17h21m40.334465402s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486366983 (17h21m40.334974063s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486892050 (17h21m40.335499132s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487479760 (17h21m40.336086842s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487681707 (17h21m40.336288776s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488328759 (17h21m40.336935845s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488375781 (17h21m40.336982854s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488895257 (17h21m40.33750234s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495361446 (17h21m40.34396853s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495390833 (17h21m40.343997919s) [seg_pos={0 0}, upload=13817]: Segment reached optimal threshold of 13 pieces.
Jul 19 16:11:58.495569782 (17h21m40.344176865s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495654740 (17h21m40.344261935s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495872315 (17h21m40.344479403s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection
Jul 19 16:11:58.495925334 (17h21m40.34453242s) [seg_pos={0 0}, upload=13817]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:11:58.496062793 (17h21m40.344669888s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:11:58.496071020 (17h21m40.344678104s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:11:58.547447138 (17h21m40.396054224s) [upload=13817]: Done uploading segments...
Jul 19 16:11:58.547468806 (17h21m40.39607588s) [upload=13817]: Upload finished. err: <nil>
Duration: 492.27542ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
494.913235ms
FAIL (2025-07-19 16:53:56 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
JAS3NAEHPQ, seg_pos={0 0}, upload=13805]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF
Jul 19 16:10:50.664428623 (17h20m32.513035707s) [seg_pos={0 0}, upload=13805]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:10:50.664509198 (17h20m32.513116285s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:10:50.664514760 (17h20m32.513121827s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:10:50.736789321 (17h20m32.585396411s) [upload=13805]: Done uploading segments...
Jul 19 16:10:50.736826215 (17h20m32.585433295s) [upload=13805]: Upload finished. err: <nil>
Jul 19 16:11:58.314006398 (17h21m40.162613482s) [upload=13817]: Starting upload
Jul 19 16:11:58.314749584 (17h21m40.16335667s) [upload=13817]: Done starting upload
Jul 19 16:11:58.315040835 (17h21m40.163647924s) [upload=13817]: Uploading segments...
Jul 19 16:11:58.315354232 (17h21m40.16396132s) [upload=13817]: Got next segment. Inline: false
Jul 19 16:11:58.315426816 (17h21m40.164033905s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 16:11:58.315434002 (17h21m40.164041082s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 16:11:58.349934256 (17h21m40.198541338s) [seg_pos={0 0}, upload=13817]: Begin upload segment...
Jul 19 16:11:58.349982513 (17h21m40.198589598s) [seg_pos={0 0}, upload=13817]: Done begin upload segment.
Jul 19 16:11:58.350018513 (17h21m40.198625595s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350588007 (17h21m40.199195095s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350804146 (17h21m40.199411237s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351514170 (17h21m40.200121264s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351771227 (17h21m40.200378315s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352670435 (17h21m40.20127752s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352723228 (17h21m40.201330314s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.353502192 (17h21m40.202109274s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.354132630 (17h21m40.202739715s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.356556981 (17h21m40.205164061s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.357776003 (17h21m40.206383088s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.360436506 (17h21m40.209043598s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.362556012 (17h21m40.211163105s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.365515091 (17h21m40.214122216s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.383635044 (17h21m40.232242128s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.384662269 (17h21m40.233269351s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.476689441 (17h21m40.325296511s) [upload=13817]: Next returned nil segment
Jul 19 16:11:58.476708926 (17h21m40.325315996s) [upload=13817]: Waiting for error group managing segments...
Jul 19 16:11:58.480780753 (17h21m40.329387833s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.482043942 (17h21m40.330651012s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.484678573 (17h21m40.333285658s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485257307 (17h21m40.333864389s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485858320 (17h21m40.334465402s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486366983 (17h21m40.334974063s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486892050 (17h21m40.335499132s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487479760 (17h21m40.336086842s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487681707 (17h21m40.336288776s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488328759 (17h21m40.336935845s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488375781 (17h21m40.336982854s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488895257 (17h21m40.33750234s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495361446 (17h21m40.34396853s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495390833 (17h21m40.343997919s) [seg_pos={0 0}, upload=13817]: Segment reached optimal threshold of 13 pieces.
Jul 19 16:11:58.495569782 (17h21m40.344176865s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495654740 (17h21m40.344261935s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495872315 (17h21m40.344479403s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection
Jul 19 16:11:58.495925334 (17h21m40.34453242s) [seg_pos={0 0}, upload=13817]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:11:58.496062793 (17h21m40.344669888s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:11:58.496071020 (17h21m40.344678104s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:11:58.547447138 (17h21m40.396054224s) [upload=13817]: Done uploading segments...
Jul 19 16:11:58.547468806 (17h21m40.39607588s) [upload=13817]: Upload finished. err: <nil>
Duration: 494.940942ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
362.983535ms
FAIL (2025-07-19 16:52:51 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
JAS3NAEHPQ, seg_pos={0 0}, upload=13805]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF
Jul 19 16:10:50.664428623 (17h20m32.513035707s) [seg_pos={0 0}, upload=13805]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:10:50.664509198 (17h20m32.513116285s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:10:50.664514760 (17h20m32.513121827s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:10:50.736789321 (17h20m32.585396411s) [upload=13805]: Done uploading segments...
Jul 19 16:10:50.736826215 (17h20m32.585433295s) [upload=13805]: Upload finished. err: <nil>
Jul 19 16:11:58.314006398 (17h21m40.162613482s) [upload=13817]: Starting upload
Jul 19 16:11:58.314749584 (17h21m40.16335667s) [upload=13817]: Done starting upload
Jul 19 16:11:58.315040835 (17h21m40.163647924s) [upload=13817]: Uploading segments...
Jul 19 16:11:58.315354232 (17h21m40.16396132s) [upload=13817]: Got next segment. Inline: false
Jul 19 16:11:58.315426816 (17h21m40.164033905s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 16:11:58.315434002 (17h21m40.164041082s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 16:11:58.349934256 (17h21m40.198541338s) [seg_pos={0 0}, upload=13817]: Begin upload segment...
Jul 19 16:11:58.349982513 (17h21m40.198589598s) [seg_pos={0 0}, upload=13817]: Done begin upload segment.
Jul 19 16:11:58.350018513 (17h21m40.198625595s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350588007 (17h21m40.199195095s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350804146 (17h21m40.199411237s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351514170 (17h21m40.200121264s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351771227 (17h21m40.200378315s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352670435 (17h21m40.20127752s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352723228 (17h21m40.201330314s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.353502192 (17h21m40.202109274s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.354132630 (17h21m40.202739715s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.356556981 (17h21m40.205164061s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.357776003 (17h21m40.206383088s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.360436506 (17h21m40.209043598s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.362556012 (17h21m40.211163105s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.365515091 (17h21m40.214122216s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.383635044 (17h21m40.232242128s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.384662269 (17h21m40.233269351s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.476689441 (17h21m40.325296511s) [upload=13817]: Next returned nil segment
Jul 19 16:11:58.476708926 (17h21m40.325315996s) [upload=13817]: Waiting for error group managing segments...
Jul 19 16:11:58.480780753 (17h21m40.329387833s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.482043942 (17h21m40.330651012s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.484678573 (17h21m40.333285658s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485257307 (17h21m40.333864389s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485858320 (17h21m40.334465402s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486366983 (17h21m40.334974063s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486892050 (17h21m40.335499132s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487479760 (17h21m40.336086842s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487681707 (17h21m40.336288776s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488328759 (17h21m40.336935845s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488375781 (17h21m40.336982854s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488895257 (17h21m40.33750234s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495361446 (17h21m40.34396853s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495390833 (17h21m40.343997919s) [seg_pos={0 0}, upload=13817]: Segment reached optimal threshold of 13 pieces.
Jul 19 16:11:58.495569782 (17h21m40.344176865s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495654740 (17h21m40.344261935s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495872315 (17h21m40.344479403s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection
Jul 19 16:11:58.495925334 (17h21m40.34453242s) [seg_pos={0 0}, upload=13817]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:11:58.496062793 (17h21m40.344669888s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:11:58.496071020 (17h21m40.344678104s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:11:58.547447138 (17h21m40.396054224s) [upload=13817]: Done uploading segments...
Jul 19 16:11:58.547468806 (17h21m40.39607588s) [upload=13817]: Upload finished. err: <nil>
Duration: 363.024948ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
423.958583ms
FAIL (2025-07-19 16:51:50 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
JAS3NAEHPQ, seg_pos={0 0}, upload=13805]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF
Jul 19 16:10:50.664428623 (17h20m32.513035707s) [seg_pos={0 0}, upload=13805]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:10:50.664509198 (17h20m32.513116285s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:10:50.664514760 (17h20m32.513121827s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:10:50.736789321 (17h20m32.585396411s) [upload=13805]: Done uploading segments...
Jul 19 16:10:50.736826215 (17h20m32.585433295s) [upload=13805]: Upload finished. err: <nil>
Jul 19 16:11:58.314006398 (17h21m40.162613482s) [upload=13817]: Starting upload
Jul 19 16:11:58.314749584 (17h21m40.16335667s) [upload=13817]: Done starting upload
Jul 19 16:11:58.315040835 (17h21m40.163647924s) [upload=13817]: Uploading segments...
Jul 19 16:11:58.315354232 (17h21m40.16396132s) [upload=13817]: Got next segment. Inline: false
Jul 19 16:11:58.315426816 (17h21m40.164033905s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 16:11:58.315434002 (17h21m40.164041082s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 16:11:58.349934256 (17h21m40.198541338s) [seg_pos={0 0}, upload=13817]: Begin upload segment...
Jul 19 16:11:58.349982513 (17h21m40.198589598s) [seg_pos={0 0}, upload=13817]: Done begin upload segment.
Jul 19 16:11:58.350018513 (17h21m40.198625595s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350588007 (17h21m40.199195095s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350804146 (17h21m40.199411237s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351514170 (17h21m40.200121264s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351771227 (17h21m40.200378315s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352670435 (17h21m40.20127752s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352723228 (17h21m40.201330314s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.353502192 (17h21m40.202109274s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.354132630 (17h21m40.202739715s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.356556981 (17h21m40.205164061s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.357776003 (17h21m40.206383088s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.360436506 (17h21m40.209043598s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.362556012 (17h21m40.211163105s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.365515091 (17h21m40.214122216s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.383635044 (17h21m40.232242128s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.384662269 (17h21m40.233269351s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.476689441 (17h21m40.325296511s) [upload=13817]: Next returned nil segment
Jul 19 16:11:58.476708926 (17h21m40.325315996s) [upload=13817]: Waiting for error group managing segments...
Jul 19 16:11:58.480780753 (17h21m40.329387833s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.482043942 (17h21m40.330651012s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.484678573 (17h21m40.333285658s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485257307 (17h21m40.333864389s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485858320 (17h21m40.334465402s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486366983 (17h21m40.334974063s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486892050 (17h21m40.335499132s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487479760 (17h21m40.336086842s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487681707 (17h21m40.336288776s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488328759 (17h21m40.336935845s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488375781 (17h21m40.336982854s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488895257 (17h21m40.33750234s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495361446 (17h21m40.34396853s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495390833 (17h21m40.343997919s) [seg_pos={0 0}, upload=13817]: Segment reached optimal threshold of 13 pieces.
Jul 19 16:11:58.495569782 (17h21m40.344176865s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495654740 (17h21m40.344261935s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495872315 (17h21m40.344479403s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection
Jul 19 16:11:58.495925334 (17h21m40.34453242s) [seg_pos={0 0}, upload=13817]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:11:58.496062793 (17h21m40.344669888s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:11:58.496071020 (17h21m40.344678104s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:11:58.547447138 (17h21m40.396054224s) [upload=13817]: Done uploading segments...
Jul 19 16:11:58.547468806 (17h21m40.39607588s) [upload=13817]: Upload finished. err: <nil>
Duration: 423.982353ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
397.688975ms
FAIL (2025-07-19 16:50:50 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
JAS3NAEHPQ, seg_pos={0 0}, upload=13805]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF
Jul 19 16:10:50.664428623 (17h20m32.513035707s) [seg_pos={0 0}, upload=13805]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:10:50.664509198 (17h20m32.513116285s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:10:50.664514760 (17h20m32.513121827s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:10:50.736789321 (17h20m32.585396411s) [upload=13805]: Done uploading segments...
Jul 19 16:10:50.736826215 (17h20m32.585433295s) [upload=13805]: Upload finished. err: <nil>
Jul 19 16:11:58.314006398 (17h21m40.162613482s) [upload=13817]: Starting upload
Jul 19 16:11:58.314749584 (17h21m40.16335667s) [upload=13817]: Done starting upload
Jul 19 16:11:58.315040835 (17h21m40.163647924s) [upload=13817]: Uploading segments...
Jul 19 16:11:58.315354232 (17h21m40.16396132s) [upload=13817]: Got next segment. Inline: false
Jul 19 16:11:58.315426816 (17h21m40.164033905s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 16:11:58.315434002 (17h21m40.164041082s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 16:11:58.349934256 (17h21m40.198541338s) [seg_pos={0 0}, upload=13817]: Begin upload segment...
Jul 19 16:11:58.349982513 (17h21m40.198589598s) [seg_pos={0 0}, upload=13817]: Done begin upload segment.
Jul 19 16:11:58.350018513 (17h21m40.198625595s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350588007 (17h21m40.199195095s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350804146 (17h21m40.199411237s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351514170 (17h21m40.200121264s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351771227 (17h21m40.200378315s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352670435 (17h21m40.20127752s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352723228 (17h21m40.201330314s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.353502192 (17h21m40.202109274s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.354132630 (17h21m40.202739715s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.356556981 (17h21m40.205164061s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.357776003 (17h21m40.206383088s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.360436506 (17h21m40.209043598s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.362556012 (17h21m40.211163105s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.365515091 (17h21m40.214122216s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.383635044 (17h21m40.232242128s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.384662269 (17h21m40.233269351s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.476689441 (17h21m40.325296511s) [upload=13817]: Next returned nil segment
Jul 19 16:11:58.476708926 (17h21m40.325315996s) [upload=13817]: Waiting for error group managing segments...
Jul 19 16:11:58.480780753 (17h21m40.329387833s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.482043942 (17h21m40.330651012s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.484678573 (17h21m40.333285658s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485257307 (17h21m40.333864389s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485858320 (17h21m40.334465402s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486366983 (17h21m40.334974063s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486892050 (17h21m40.335499132s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487479760 (17h21m40.336086842s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487681707 (17h21m40.336288776s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488328759 (17h21m40.336935845s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488375781 (17h21m40.336982854s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488895257 (17h21m40.33750234s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495361446 (17h21m40.34396853s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495390833 (17h21m40.343997919s) [seg_pos={0 0}, upload=13817]: Segment reached optimal threshold of 13 pieces.
Jul 19 16:11:58.495569782 (17h21m40.344176865s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495654740 (17h21m40.344261935s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495872315 (17h21m40.344479403s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection
Jul 19 16:11:58.495925334 (17h21m40.34453242s) [seg_pos={0 0}, upload=13817]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:11:58.496062793 (17h21m40.344669888s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:11:58.496071020 (17h21m40.344678104s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:11:58.547447138 (17h21m40.396054224s) [upload=13817]: Done uploading segments...
Jul 19 16:11:58.547468806 (17h21m40.39607588s) [upload=13817]: Upload finished. err: <nil>
Duration: 397.725026ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
470.197154ms
FAIL (2025-07-19 16:50:26 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
JAS3NAEHPQ, seg_pos={0 0}, upload=13805]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF
Jul 19 16:10:50.664428623 (17h20m32.513035707s) [seg_pos={0 0}, upload=13805]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:10:50.664509198 (17h20m32.513116285s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:10:50.664514760 (17h20m32.513121827s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:10:50.736789321 (17h20m32.585396411s) [upload=13805]: Done uploading segments...
Jul 19 16:10:50.736826215 (17h20m32.585433295s) [upload=13805]: Upload finished. err: <nil>
Jul 19 16:11:58.314006398 (17h21m40.162613482s) [upload=13817]: Starting upload
Jul 19 16:11:58.314749584 (17h21m40.16335667s) [upload=13817]: Done starting upload
Jul 19 16:11:58.315040835 (17h21m40.163647924s) [upload=13817]: Uploading segments...
Jul 19 16:11:58.315354232 (17h21m40.16396132s) [upload=13817]: Got next segment. Inline: false
Jul 19 16:11:58.315426816 (17h21m40.164033905s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 16:11:58.315434002 (17h21m40.164041082s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 16:11:58.349934256 (17h21m40.198541338s) [seg_pos={0 0}, upload=13817]: Begin upload segment...
Jul 19 16:11:58.349982513 (17h21m40.198589598s) [seg_pos={0 0}, upload=13817]: Done begin upload segment.
Jul 19 16:11:58.350018513 (17h21m40.198625595s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350588007 (17h21m40.199195095s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350804146 (17h21m40.199411237s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351514170 (17h21m40.200121264s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351771227 (17h21m40.200378315s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352670435 (17h21m40.20127752s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352723228 (17h21m40.201330314s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.353502192 (17h21m40.202109274s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.354132630 (17h21m40.202739715s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.356556981 (17h21m40.205164061s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.357776003 (17h21m40.206383088s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.360436506 (17h21m40.209043598s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.362556012 (17h21m40.211163105s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.365515091 (17h21m40.214122216s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.383635044 (17h21m40.232242128s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.384662269 (17h21m40.233269351s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.476689441 (17h21m40.325296511s) [upload=13817]: Next returned nil segment
Jul 19 16:11:58.476708926 (17h21m40.325315996s) [upload=13817]: Waiting for error group managing segments...
Jul 19 16:11:58.480780753 (17h21m40.329387833s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.482043942 (17h21m40.330651012s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.484678573 (17h21m40.333285658s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485257307 (17h21m40.333864389s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485858320 (17h21m40.334465402s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486366983 (17h21m40.334974063s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486892050 (17h21m40.335499132s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487479760 (17h21m40.336086842s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487681707 (17h21m40.336288776s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488328759 (17h21m40.336935845s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488375781 (17h21m40.336982854s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488895257 (17h21m40.33750234s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495361446 (17h21m40.34396853s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495390833 (17h21m40.343997919s) [seg_pos={0 0}, upload=13817]: Segment reached optimal threshold of 13 pieces.
Jul 19 16:11:58.495569782 (17h21m40.344176865s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495654740 (17h21m40.344261935s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495872315 (17h21m40.344479403s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection
Jul 19 16:11:58.495925334 (17h21m40.34453242s) [seg_pos={0 0}, upload=13817]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:11:58.496062793 (17h21m40.344669888s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:11:58.496071020 (17h21m40.344678104s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:11:58.547447138 (17h21m40.396054224s) [upload=13817]: Done uploading segments...
Jul 19 16:11:58.547468806 (17h21m40.39607588s) [upload=13817]: Upload finished. err: <nil>
Duration: 470.231987ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
471.30699ms
FAIL (2025-07-19 16:49:24 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
JAS3NAEHPQ, seg_pos={0 0}, upload=13805]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF
Jul 19 16:10:50.664428623 (17h20m32.513035707s) [seg_pos={0 0}, upload=13805]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:10:50.664509198 (17h20m32.513116285s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:10:50.664514760 (17h20m32.513121827s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:10:50.736789321 (17h20m32.585396411s) [upload=13805]: Done uploading segments...
Jul 19 16:10:50.736826215 (17h20m32.585433295s) [upload=13805]: Upload finished. err: <nil>
Jul 19 16:11:58.314006398 (17h21m40.162613482s) [upload=13817]: Starting upload
Jul 19 16:11:58.314749584 (17h21m40.16335667s) [upload=13817]: Done starting upload
Jul 19 16:11:58.315040835 (17h21m40.163647924s) [upload=13817]: Uploading segments...
Jul 19 16:11:58.315354232 (17h21m40.16396132s) [upload=13817]: Got next segment. Inline: false
Jul 19 16:11:58.315426816 (17h21m40.164033905s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 16:11:58.315434002 (17h21m40.164041082s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 16:11:58.349934256 (17h21m40.198541338s) [seg_pos={0 0}, upload=13817]: Begin upload segment...
Jul 19 16:11:58.349982513 (17h21m40.198589598s) [seg_pos={0 0}, upload=13817]: Done begin upload segment.
Jul 19 16:11:58.350018513 (17h21m40.198625595s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350588007 (17h21m40.199195095s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350804146 (17h21m40.199411237s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351514170 (17h21m40.200121264s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351771227 (17h21m40.200378315s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352670435 (17h21m40.20127752s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352723228 (17h21m40.201330314s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.353502192 (17h21m40.202109274s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.354132630 (17h21m40.202739715s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.356556981 (17h21m40.205164061s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.357776003 (17h21m40.206383088s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.360436506 (17h21m40.209043598s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.362556012 (17h21m40.211163105s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.365515091 (17h21m40.214122216s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.383635044 (17h21m40.232242128s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.384662269 (17h21m40.233269351s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.476689441 (17h21m40.325296511s) [upload=13817]: Next returned nil segment
Jul 19 16:11:58.476708926 (17h21m40.325315996s) [upload=13817]: Waiting for error group managing segments...
Jul 19 16:11:58.480780753 (17h21m40.329387833s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.482043942 (17h21m40.330651012s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.484678573 (17h21m40.333285658s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485257307 (17h21m40.333864389s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485858320 (17h21m40.334465402s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486366983 (17h21m40.334974063s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486892050 (17h21m40.335499132s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487479760 (17h21m40.336086842s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487681707 (17h21m40.336288776s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488328759 (17h21m40.336935845s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488375781 (17h21m40.336982854s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488895257 (17h21m40.33750234s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495361446 (17h21m40.34396853s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495390833 (17h21m40.343997919s) [seg_pos={0 0}, upload=13817]: Segment reached optimal threshold of 13 pieces.
Jul 19 16:11:58.495569782 (17h21m40.344176865s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495654740 (17h21m40.344261935s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495872315 (17h21m40.344479403s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection
Jul 19 16:11:58.495925334 (17h21m40.34453242s) [seg_pos={0 0}, upload=13817]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:11:58.496062793 (17h21m40.344669888s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:11:58.496071020 (17h21m40.344678104s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:11:58.547447138 (17h21m40.396054224s) [upload=13817]: Done uploading segments...
Jul 19 16:11:58.547468806 (17h21m40.39607588s) [upload=13817]: Upload finished. err: <nil>
Duration: 471.334853ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
503.378506ms
FAIL (2025-07-19 16:48:18 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
JAS3NAEHPQ, seg_pos={0 0}, upload=13805]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF
Jul 19 16:10:50.664428623 (17h20m32.513035707s) [seg_pos={0 0}, upload=13805]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:10:50.664509198 (17h20m32.513116285s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:10:50.664514760 (17h20m32.513121827s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:10:50.736789321 (17h20m32.585396411s) [upload=13805]: Done uploading segments...
Jul 19 16:10:50.736826215 (17h20m32.585433295s) [upload=13805]: Upload finished. err: <nil>
Jul 19 16:11:58.314006398 (17h21m40.162613482s) [upload=13817]: Starting upload
Jul 19 16:11:58.314749584 (17h21m40.16335667s) [upload=13817]: Done starting upload
Jul 19 16:11:58.315040835 (17h21m40.163647924s) [upload=13817]: Uploading segments...
Jul 19 16:11:58.315354232 (17h21m40.16396132s) [upload=13817]: Got next segment. Inline: false
Jul 19 16:11:58.315426816 (17h21m40.164033905s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 16:11:58.315434002 (17h21m40.164041082s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 16:11:58.349934256 (17h21m40.198541338s) [seg_pos={0 0}, upload=13817]: Begin upload segment...
Jul 19 16:11:58.349982513 (17h21m40.198589598s) [seg_pos={0 0}, upload=13817]: Done begin upload segment.
Jul 19 16:11:58.350018513 (17h21m40.198625595s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350588007 (17h21m40.199195095s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350804146 (17h21m40.199411237s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351514170 (17h21m40.200121264s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351771227 (17h21m40.200378315s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352670435 (17h21m40.20127752s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352723228 (17h21m40.201330314s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.353502192 (17h21m40.202109274s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.354132630 (17h21m40.202739715s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.356556981 (17h21m40.205164061s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.357776003 (17h21m40.206383088s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.360436506 (17h21m40.209043598s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.362556012 (17h21m40.211163105s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.365515091 (17h21m40.214122216s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.383635044 (17h21m40.232242128s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.384662269 (17h21m40.233269351s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.476689441 (17h21m40.325296511s) [upload=13817]: Next returned nil segment
Jul 19 16:11:58.476708926 (17h21m40.325315996s) [upload=13817]: Waiting for error group managing segments...
Jul 19 16:11:58.480780753 (17h21m40.329387833s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.482043942 (17h21m40.330651012s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.484678573 (17h21m40.333285658s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485257307 (17h21m40.333864389s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485858320 (17h21m40.334465402s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486366983 (17h21m40.334974063s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486892050 (17h21m40.335499132s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487479760 (17h21m40.336086842s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487681707 (17h21m40.336288776s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488328759 (17h21m40.336935845s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488375781 (17h21m40.336982854s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488895257 (17h21m40.33750234s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495361446 (17h21m40.34396853s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495390833 (17h21m40.343997919s) [seg_pos={0 0}, upload=13817]: Segment reached optimal threshold of 13 pieces.
Jul 19 16:11:58.495569782 (17h21m40.344176865s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495654740 (17h21m40.344261935s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495872315 (17h21m40.344479403s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection
Jul 19 16:11:58.495925334 (17h21m40.34453242s) [seg_pos={0 0}, upload=13817]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:11:58.496062793 (17h21m40.344669888s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:11:58.496071020 (17h21m40.344678104s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:11:58.547447138 (17h21m40.396054224s) [upload=13817]: Done uploading segments...
Jul 19 16:11:58.547468806 (17h21m40.39607588s) [upload=13817]: Upload finished. err: <nil>
Duration: 503.412556ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
469.361212ms
FAIL (2025-07-19 16:47:05 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
JAS3NAEHPQ, seg_pos={0 0}, upload=13805]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF
Jul 19 16:10:50.664428623 (17h20m32.513035707s) [seg_pos={0 0}, upload=13805]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:10:50.664509198 (17h20m32.513116285s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:10:50.664514760 (17h20m32.513121827s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:10:50.736789321 (17h20m32.585396411s) [upload=13805]: Done uploading segments...
Jul 19 16:10:50.736826215 (17h20m32.585433295s) [upload=13805]: Upload finished. err: <nil>
Jul 19 16:11:58.314006398 (17h21m40.162613482s) [upload=13817]: Starting upload
Jul 19 16:11:58.314749584 (17h21m40.16335667s) [upload=13817]: Done starting upload
Jul 19 16:11:58.315040835 (17h21m40.163647924s) [upload=13817]: Uploading segments...
Jul 19 16:11:58.315354232 (17h21m40.16396132s) [upload=13817]: Got next segment. Inline: false
Jul 19 16:11:58.315426816 (17h21m40.164033905s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 16:11:58.315434002 (17h21m40.164041082s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 16:11:58.349934256 (17h21m40.198541338s) [seg_pos={0 0}, upload=13817]: Begin upload segment...
Jul 19 16:11:58.349982513 (17h21m40.198589598s) [seg_pos={0 0}, upload=13817]: Done begin upload segment.
Jul 19 16:11:58.350018513 (17h21m40.198625595s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350588007 (17h21m40.199195095s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350804146 (17h21m40.199411237s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351514170 (17h21m40.200121264s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351771227 (17h21m40.200378315s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352670435 (17h21m40.20127752s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352723228 (17h21m40.201330314s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.353502192 (17h21m40.202109274s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.354132630 (17h21m40.202739715s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.356556981 (17h21m40.205164061s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.357776003 (17h21m40.206383088s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.360436506 (17h21m40.209043598s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.362556012 (17h21m40.211163105s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.365515091 (17h21m40.214122216s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.383635044 (17h21m40.232242128s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.384662269 (17h21m40.233269351s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.476689441 (17h21m40.325296511s) [upload=13817]: Next returned nil segment
Jul 19 16:11:58.476708926 (17h21m40.325315996s) [upload=13817]: Waiting for error group managing segments...
Jul 19 16:11:58.480780753 (17h21m40.329387833s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.482043942 (17h21m40.330651012s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.484678573 (17h21m40.333285658s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485257307 (17h21m40.333864389s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485858320 (17h21m40.334465402s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486366983 (17h21m40.334974063s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486892050 (17h21m40.335499132s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487479760 (17h21m40.336086842s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487681707 (17h21m40.336288776s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488328759 (17h21m40.336935845s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488375781 (17h21m40.336982854s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488895257 (17h21m40.33750234s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495361446 (17h21m40.34396853s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495390833 (17h21m40.343997919s) [seg_pos={0 0}, upload=13817]: Segment reached optimal threshold of 13 pieces.
Jul 19 16:11:58.495569782 (17h21m40.344176865s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495654740 (17h21m40.344261935s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495872315 (17h21m40.344479403s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection
Jul 19 16:11:58.495925334 (17h21m40.34453242s) [seg_pos={0 0}, upload=13817]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:11:58.496062793 (17h21m40.344669888s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:11:58.496071020 (17h21m40.344678104s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:11:58.547447138 (17h21m40.396054224s) [upload=13817]: Done uploading segments...
Jul 19 16:11:58.547468806 (17h21m40.39607588s) [upload=13817]: Upload finished. err: <nil>
Duration: 469.386932ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
447.481807ms
FAIL (2025-07-19 16:46:37 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
JAS3NAEHPQ, seg_pos={0 0}, upload=13805]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF
Jul 19 16:10:50.664428623 (17h20m32.513035707s) [seg_pos={0 0}, upload=13805]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:10:50.664509198 (17h20m32.513116285s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:10:50.664514760 (17h20m32.513121827s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:10:50.736789321 (17h20m32.585396411s) [upload=13805]: Done uploading segments...
Jul 19 16:10:50.736826215 (17h20m32.585433295s) [upload=13805]: Upload finished. err: <nil>
Jul 19 16:11:58.314006398 (17h21m40.162613482s) [upload=13817]: Starting upload
Jul 19 16:11:58.314749584 (17h21m40.16335667s) [upload=13817]: Done starting upload
Jul 19 16:11:58.315040835 (17h21m40.163647924s) [upload=13817]: Uploading segments...
Jul 19 16:11:58.315354232 (17h21m40.16396132s) [upload=13817]: Got next segment. Inline: false
Jul 19 16:11:58.315426816 (17h21m40.164033905s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 16:11:58.315434002 (17h21m40.164041082s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 16:11:58.349934256 (17h21m40.198541338s) [seg_pos={0 0}, upload=13817]: Begin upload segment...
Jul 19 16:11:58.349982513 (17h21m40.198589598s) [seg_pos={0 0}, upload=13817]: Done begin upload segment.
Jul 19 16:11:58.350018513 (17h21m40.198625595s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350588007 (17h21m40.199195095s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350804146 (17h21m40.199411237s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351514170 (17h21m40.200121264s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351771227 (17h21m40.200378315s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352670435 (17h21m40.20127752s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352723228 (17h21m40.201330314s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.353502192 (17h21m40.202109274s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.354132630 (17h21m40.202739715s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.356556981 (17h21m40.205164061s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.357776003 (17h21m40.206383088s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.360436506 (17h21m40.209043598s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.362556012 (17h21m40.211163105s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.365515091 (17h21m40.214122216s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.383635044 (17h21m40.232242128s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.384662269 (17h21m40.233269351s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.476689441 (17h21m40.325296511s) [upload=13817]: Next returned nil segment
Jul 19 16:11:58.476708926 (17h21m40.325315996s) [upload=13817]: Waiting for error group managing segments...
Jul 19 16:11:58.480780753 (17h21m40.329387833s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.482043942 (17h21m40.330651012s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.484678573 (17h21m40.333285658s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485257307 (17h21m40.333864389s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485858320 (17h21m40.334465402s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486366983 (17h21m40.334974063s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486892050 (17h21m40.335499132s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487479760 (17h21m40.336086842s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487681707 (17h21m40.336288776s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488328759 (17h21m40.336935845s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488375781 (17h21m40.336982854s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488895257 (17h21m40.33750234s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495361446 (17h21m40.34396853s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495390833 (17h21m40.343997919s) [seg_pos={0 0}, upload=13817]: Segment reached optimal threshold of 13 pieces.
Jul 19 16:11:58.495569782 (17h21m40.344176865s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495654740 (17h21m40.344261935s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495872315 (17h21m40.344479403s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection
Jul 19 16:11:58.495925334 (17h21m40.34453242s) [seg_pos={0 0}, upload=13817]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:11:58.496062793 (17h21m40.344669888s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:11:58.496071020 (17h21m40.344678104s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:11:58.547447138 (17h21m40.396054224s) [upload=13817]: Done uploading segments...
Jul 19 16:11:58.547468806 (17h21m40.39607588s) [upload=13817]: Upload finished. err: <nil>
Duration: 447.509283ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
478.358587ms
FAIL (2025-07-19 16:46:09 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
JAS3NAEHPQ, seg_pos={0 0}, upload=13805]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF
Jul 19 16:10:50.664428623 (17h20m32.513035707s) [seg_pos={0 0}, upload=13805]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:10:50.664509198 (17h20m32.513116285s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:10:50.664514760 (17h20m32.513121827s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:10:50.736789321 (17h20m32.585396411s) [upload=13805]: Done uploading segments...
Jul 19 16:10:50.736826215 (17h20m32.585433295s) [upload=13805]: Upload finished. err: <nil>
Jul 19 16:11:58.314006398 (17h21m40.162613482s) [upload=13817]: Starting upload
Jul 19 16:11:58.314749584 (17h21m40.16335667s) [upload=13817]: Done starting upload
Jul 19 16:11:58.315040835 (17h21m40.163647924s) [upload=13817]: Uploading segments...
Jul 19 16:11:58.315354232 (17h21m40.16396132s) [upload=13817]: Got next segment. Inline: false
Jul 19 16:11:58.315426816 (17h21m40.164033905s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 16:11:58.315434002 (17h21m40.164041082s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 16:11:58.349934256 (17h21m40.198541338s) [seg_pos={0 0}, upload=13817]: Begin upload segment...
Jul 19 16:11:58.349982513 (17h21m40.198589598s) [seg_pos={0 0}, upload=13817]: Done begin upload segment.
Jul 19 16:11:58.350018513 (17h21m40.198625595s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350588007 (17h21m40.199195095s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350804146 (17h21m40.199411237s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351514170 (17h21m40.200121264s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351771227 (17h21m40.200378315s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352670435 (17h21m40.20127752s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352723228 (17h21m40.201330314s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.353502192 (17h21m40.202109274s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.354132630 (17h21m40.202739715s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.356556981 (17h21m40.205164061s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.357776003 (17h21m40.206383088s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.360436506 (17h21m40.209043598s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.362556012 (17h21m40.211163105s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.365515091 (17h21m40.214122216s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.383635044 (17h21m40.232242128s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.384662269 (17h21m40.233269351s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.476689441 (17h21m40.325296511s) [upload=13817]: Next returned nil segment
Jul 19 16:11:58.476708926 (17h21m40.325315996s) [upload=13817]: Waiting for error group managing segments...
Jul 19 16:11:58.480780753 (17h21m40.329387833s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.482043942 (17h21m40.330651012s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.484678573 (17h21m40.333285658s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485257307 (17h21m40.333864389s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485858320 (17h21m40.334465402s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486366983 (17h21m40.334974063s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486892050 (17h21m40.335499132s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487479760 (17h21m40.336086842s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487681707 (17h21m40.336288776s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488328759 (17h21m40.336935845s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488375781 (17h21m40.336982854s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488895257 (17h21m40.33750234s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495361446 (17h21m40.34396853s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495390833 (17h21m40.343997919s) [seg_pos={0 0}, upload=13817]: Segment reached optimal threshold of 13 pieces.
Jul 19 16:11:58.495569782 (17h21m40.344176865s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495654740 (17h21m40.344261935s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495872315 (17h21m40.344479403s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection
Jul 19 16:11:58.495925334 (17h21m40.34453242s) [seg_pos={0 0}, upload=13817]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:11:58.496062793 (17h21m40.344669888s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:11:58.496071020 (17h21m40.344678104s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:11:58.547447138 (17h21m40.396054224s) [upload=13817]: Done uploading segments...
Jul 19 16:11:58.547468806 (17h21m40.39607588s) [upload=13817]: Upload finished. err: <nil>
Duration: 478.387097ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
460.885385ms
FAIL (2025-07-19 16:45:48 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
JAS3NAEHPQ, seg_pos={0 0}, upload=13805]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FcPS8yXfgdFvsxFofPrNCtFDLtebQMTaLu75335kVXeQxttuv): protocol: expected piece hash; context canceled; EOF
Jul 19 16:10:50.664428623 (17h20m32.513035707s) [seg_pos={0 0}, upload=13805]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:10:50.664509198 (17h20m32.513116285s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:10:50.664514760 (17h20m32.513121827s) [upload=13805]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:10:50.736789321 (17h20m32.585396411s) [upload=13805]: Done uploading segments...
Jul 19 16:10:50.736826215 (17h20m32.585433295s) [upload=13805]: Upload finished. err: <nil>
Jul 19 16:11:58.314006398 (17h21m40.162613482s) [upload=13817]: Starting upload
Jul 19 16:11:58.314749584 (17h21m40.16335667s) [upload=13817]: Done starting upload
Jul 19 16:11:58.315040835 (17h21m40.163647924s) [upload=13817]: Uploading segments...
Jul 19 16:11:58.315354232 (17h21m40.16396132s) [upload=13817]: Got next segment. Inline: false
Jul 19 16:11:58.315426816 (17h21m40.164033905s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 19 16:11:58.315434002 (17h21m40.164041082s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 19 16:11:58.349934256 (17h21m40.198541338s) [seg_pos={0 0}, upload=13817]: Begin upload segment...
Jul 19 16:11:58.349982513 (17h21m40.198589598s) [seg_pos={0 0}, upload=13817]: Done begin upload segment.
Jul 19 16:11:58.350018513 (17h21m40.198625595s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350588007 (17h21m40.199195095s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.350804146 (17h21m40.199411237s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351514170 (17h21m40.200121264s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.351771227 (17h21m40.200378315s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352670435 (17h21m40.20127752s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.352723228 (17h21m40.201330314s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.353502192 (17h21m40.202109274s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.354132630 (17h21m40.202739715s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.356556981 (17h21m40.205164061s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.357776003 (17h21m40.206383088s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.360436506 (17h21m40.209043598s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.362556012 (17h21m40.211163105s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.365515091 (17h21m40.214122216s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.383635044 (17h21m40.232242128s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.384662269 (17h21m40.233269351s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Uploading piece...
Jul 19 16:11:58.476689441 (17h21m40.325296511s) [upload=13817]: Next returned nil segment
Jul 19 16:11:58.476708926 (17h21m40.325315996s) [upload=13817]: Waiting for error group managing segments...
Jul 19 16:11:58.480780753 (17h21m40.329387833s) [noise=true , address=45.91.116.12:4225 , piece_id=OV5YKOGQRWBHCHSGDWE6PCOXKQJD2WLPFXYKBZV4SATEQL57J23Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.482043942 (17h21m40.330651012s) [noise=true , address=77.90.31.12:4589 , piece_id=Y4RBW4INNW5HBWR4BUUU6Z7EJCKJPIOYU2QJXFEQ7O5RJXIQSL2Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.484678573 (17h21m40.333285658s) [noise=true , address=45.91.116.7:4011 , piece_id=I3HNWXHWLEQGFJB7PTS5SHME5VVMR2OP2DTPSCCAUPAWZEPNOEDA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485257307 (17h21m40.333864389s) [noise=true , address=45.91.116.4:4938 , piece_id=7Z4MSRXBGSCVXARUZ4WBFKFSJRXAUCIQDC72J2FB4AYL4K2OZNPA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.485858320 (17h21m40.334465402s) [noise=true , address=45.91.116.5:4298 , piece_id=BGNVOK6Q67PU5H5ALPXYDXBWUXNMFFP7KQKUV7TT2KRPAAO35O6Q, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486366983 (17h21m40.334974063s) [noise=true , address=45.91.116.13:4153 , piece_id=ZMLT5WM7H7IQ3RHHU6CSXGXRLERF3RWWWWHGPA7TDAS3BETGNNQQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.486892050 (17h21m40.335499132s) [noise=true , address=45.91.116.4:4940 , piece_id=QYXIUAGE6W2VBGNZIPLOQJ5HPRTQ4I5SLX74OJUXBFL7SP63QZGQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487479760 (17h21m40.336086842s) [noise=true , address=77.90.31.10:4518 , piece_id=C5KB3C7FEJYBWU43664CEQF4ICN2UJXHGVB3SWRIQZRUE3NC6IAQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.487681707 (17h21m40.336288776s) [noise=true , address=45.91.116.14:4191 , piece_id=EB6TGUJJWKD667EIB5FA7D3GAS6XZLPW5NBZUFNGWNVKWRFLOZZA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488328759 (17h21m40.336935845s) [noise=true , address=77.90.31.15:4699 , piece_id=7DNHHOXWMCVZQZ2NJ7QYW22VYSUC44HMUS5TJUQZSVCJVT3L4ADQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488375781 (17h21m40.336982854s) [noise=true , address=45.91.116.9:4262 , piece_id=37BND3Y46FZYULQ3VWYYQL4HTYVF26QOTY2W2UBZVBGE7HJ34QNA, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.488895257 (17h21m40.33750234s) [noise=true , address=104.36.82.6:4876 , piece_id=2K4CLNEXGGP3N4DF4YRWISAUJY2RPD2ZNKGH6WOD7WBF4FD5DOIQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495361446 (17h21m40.34396853s) [noise=true , address=104.36.82.14:4222 , piece_id=MUEYBPLWRIL7O6TRUIALB7QCV6NWBR24JAHCQIJECXH7EX6CESHQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: <nil>
Jul 19 16:11:58.495390833 (17h21m40.343997919s) [seg_pos={0 0}, upload=13817]: Segment reached optimal threshold of 13 pieces.
Jul 19 16:11:58.495569782 (17h21m40.344176865s) [noise=true , address=104.36.82.13:4187 , piece_id=CEKQJDKH3D5KGFMLU4UGHEO23OFXPB46YFOQNLWUKEUZQ2JFMJ2A, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12cQxBB2L2CyymYx3xWp1ALj6p8QWr4A34sqvtG5zyeT7sVWv7x): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495654740 (17h21m40.344261935s) [noise=true , address=104.36.82.9:4005 , piece_id=7EH7CSLKKWXZEHDX7NTECU5L5EJ4L4VIEUSX4JBNF6AGCHSJJ6LQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF
Jul 19 16:11:58.495872315 (17h21m40.344479403s) [noise=true , address=104.36.82.10:4078 , piece_id=AJ4HEQ5WBS7SZRLRTSXBYMPRYQD2GF545MIDXA3QM5M3IFDOG5FQ, seg_pos={0 0}, upload=13817]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XATjg9fmRUK8ianyYsEgDMvA3wByoKPdztMnM98XSdYBxyFdr): protocol: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:32812->104.36.82.10:4078: use of closed network connection
Jul 19 16:11:58.495925334 (17h21m40.34453242s) [seg_pos={0 0}, upload=13817]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 19 16:11:58.496062793 (17h21m40.344669888s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 19 16:11:58.496071020 (17h21m40.344678104s) [upload=13817]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 19 16:11:58.547447138 (17h21m40.396054224s) [upload=13817]: Done uploading segments...
Jul 19 16:11:58.547468806 (17h21m40.39607588s) [upload=13817]: Upload finished. err: <nil>
Duration: 460.91556ms
core
uplink
us-select-1
|