Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
1.715712099s
FAIL (2025-06-30 17:50:10 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.715800887s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
1.780584613s
FAIL (2025-06-30 17:49:08 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.780610964s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
1.74680237s
FAIL (2025-06-30 17:48:02 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.746839626s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
1.768105787s
FAIL (2025-06-30 17:47:19 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.768136248s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
1.918475788s
FAIL (2025-06-30 17:46:52 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.918502943s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
1.789194369s
FAIL (2025-06-30 17:46:09 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.789228088s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
1.648316483s
FAIL (2025-06-30 17:45:31 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.648345526s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
1.7268764s
FAIL (2025-06-30 17:44:58 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.726905767s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
1.632592045s
FAIL (2025-06-30 17:44:30 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.632620096s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
1.810506309s
FAIL (2025-06-30 17:43:19 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.810532585s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
1.674377356s
FAIL (2025-06-30 17:42:20 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.674405481s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
1.710741026s
FAIL (2025-06-30 17:41:54 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.71076871s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
1.842880384s
FAIL (2025-06-30 17:41:07 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.84290385s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
1.737736628s
FAIL (2025-06-30 17:40:12 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.737765941s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
1.84497488s
FAIL (2025-06-30 17:39:51 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.845011131s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
1.767409484s
FAIL (2025-06-30 17:38:55 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.767437702s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
1.770590538s
FAIL (2025-06-30 17:37:57 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.770613903s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
1.733739903s
FAIL (2025-06-30 17:36:55 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.733768122s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
1.679977961s
FAIL (2025-06-30 17:35:51 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.680015204s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
1.861378226s
FAIL (2025-06-30 17:34:42 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.861401812s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
1.722499964s
FAIL (2025-06-30 17:34:20 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.722527145s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
1.906228784s
FAIL (2025-06-30 17:33:07 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.90625524s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
1.744052443s
FAIL (2025-06-30 17:32:21 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.744082017s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
1.685705648s
FAIL (2025-06-30 17:32:05 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.68574424s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
1.775367322s
FAIL (2025-06-30 17:31:17 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.775394327s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
1.608667716s
FAIL (2025-06-30 17:30:33 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.60869789s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
1.62434038s
FAIL (2025-06-30 17:29:52 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.624434403s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
1.766508982s
FAIL (2025-06-30 17:29:33 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.766532686s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
1.836690964s
FAIL (2025-06-30 17:28:37 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.83672943s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
1.818201961s
FAIL (2025-06-30 17:27:28 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.81822879s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
1.772331606s
FAIL (2025-06-30 17:26:29 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.772362285s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
1.683808426s
FAIL (2025-06-30 17:26:06 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 1.6838312s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.066719275s
FAIL (2025-06-30 17:26:04 UTC)
orbiter warning: uplink: metaclient: context deadline exceeded
Duration: 30.066758189s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
229.095622ms
FAIL (2025-06-30 13:48:52 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil>
Duration: 229.127415ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
260.507927ms
FAIL (2025-06-30 13:47:52 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil>
Duration: 260.548924ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
257.054687ms
FAIL (2025-06-30 13:46:38 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil>
Duration: 257.10691ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
350.506206ms
FAIL (2025-06-30 13:45:39 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil>
Duration: 350.537182ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
230.107675ms
FAIL (2025-06-30 13:45:10 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil>
Duration: 230.133122ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
248.133338ms
FAIL (2025-06-30 13:44:41 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil>
Duration: 248.160217ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
239.528536ms
FAIL (2025-06-30 13:43:45 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil>
Duration: 239.555992ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
248.240276ms
FAIL (2025-06-30 13:42:41 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil>
Duration: 248.295583ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
230.566491ms
FAIL (2025-06-30 13:41:36 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil>
Duration: 230.641673ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
340.768343ms
FAIL (2025-06-30 13:40:54 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil>
Duration: 340.895143ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
252.614ms
FAIL (2025-06-30 13:40:16 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil>
Duration: 252.692401ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
252.893044ms
FAIL (2025-06-30 13:39:05 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil>
Duration: 252.922976ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
469.329047ms
FAIL (2025-06-30 13:38:49 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil>
Duration: 469.35523ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
218.555827ms
FAIL (2025-06-30 13:37:47 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil>
Duration: 218.57845ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
246.821128ms
FAIL (2025-06-30 13:37:21 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil>
Duration: 246.853463ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
273.870649ms
FAIL (2025-06-30 13:36:37 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil>
Duration: 273.898755ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
227.038826ms
FAIL (2025-06-30 13:35:29 UTC)
orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil>
Duration: 227.064006ms
core
uplink
us-select-1
|