Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 1.744052443s FAIL (2025-06-30 17:32:21 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 1.744082017s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 1.685705648s FAIL (2025-06-30 17:32:05 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 1.68574424s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 1.775367322s FAIL (2025-06-30 17:31:17 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 1.775394327s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 1.608667716s FAIL (2025-06-30 17:30:33 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 1.60869789s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 1.62434038s FAIL (2025-06-30 17:29:52 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 1.624434403s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 1.766508982s FAIL (2025-06-30 17:29:33 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 1.766532686s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 1.836690964s FAIL (2025-06-30 17:28:37 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 1.83672943s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 1.818201961s FAIL (2025-06-30 17:27:28 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 1.81822879s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 1.772331606s FAIL (2025-06-30 17:26:29 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 1.772362285s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 1.683808426s FAIL (2025-06-30 17:26:06 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 1.6838312s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.066719275s FAIL (2025-06-30 17:26:04 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 30.066758189s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 229.095622ms FAIL (2025-06-30 13:48:52 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 229.127415ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 260.507927ms FAIL (2025-06-30 13:47:52 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 260.548924ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 257.054687ms FAIL (2025-06-30 13:46:38 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 257.10691ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 350.506206ms FAIL (2025-06-30 13:45:39 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 350.537182ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 230.107675ms FAIL (2025-06-30 13:45:10 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 230.133122ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 248.133338ms FAIL (2025-06-30 13:44:41 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 248.160217ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 239.528536ms FAIL (2025-06-30 13:43:45 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 239.555992ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 248.240276ms FAIL (2025-06-30 13:42:41 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 248.295583ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 230.566491ms FAIL (2025-06-30 13:41:36 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 230.641673ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 340.768343ms FAIL (2025-06-30 13:40:54 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 340.895143ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 252.614ms FAIL (2025-06-30 13:40:16 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 252.692401ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 252.893044ms FAIL (2025-06-30 13:39:05 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 252.922976ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 469.329047ms FAIL (2025-06-30 13:38:49 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 469.35523ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 218.555827ms FAIL (2025-06-30 13:37:47 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 218.57845ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 246.821128ms FAIL (2025-06-30 13:37:21 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 246.853463ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 273.870649ms FAIL (2025-06-30 13:36:37 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 273.898755ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 227.038826ms FAIL (2025-06-30 13:35:29 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 227.064006ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 269.651054ms FAIL (2025-06-30 13:34:37 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 269.681902ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 228.357426ms FAIL (2025-06-30 13:33:34 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 228.385178ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 265.29508ms FAIL (2025-06-30 13:32:52 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 265.424759ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 304.610812ms FAIL (2025-06-30 13:32:16 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 304.639881ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 232.91299ms FAIL (2025-06-30 13:31:45 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 232.962832ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 424.899634ms FAIL (2025-06-30 13:31:17 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 424.930671ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 252.820221ms FAIL (2025-06-30 13:30:40 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 252.848014ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 220.941661ms FAIL (2025-06-30 13:29:51 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 220.971017ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 223.113197ms FAIL (2025-06-30 13:28:51 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 223.140116ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 251.179228ms FAIL (2025-06-30 13:28:11 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 251.22827ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 254.945471ms FAIL (2025-06-30 13:27:11 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 254.971589ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 224.418516ms FAIL (2025-06-30 13:26:43 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 224.452178ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 263.827168ms FAIL (2025-06-30 13:26:18 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 263.859676ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 219.954321ms FAIL (2025-06-30 13:25:55 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 219.977374ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 244.603798ms FAIL (2025-06-30 13:24:58 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 244.637896ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 233.054611ms FAIL (2025-06-30 13:24:10 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 233.098888ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 301.574041ms FAIL (2025-06-30 13:23:52 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 301.602386ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 220.604241ms FAIL (2025-06-30 13:22:54 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 220.635799ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 261.79105ms FAIL (2025-06-30 13:21:45 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 261.823131ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 245.198836ms FAIL (2025-06-30 13:20:46 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 245.279267ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 251.326962ms FAIL (2025-06-30 13:20:26 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 251.357775ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 232.056802ms FAIL (2025-06-30 13:19:37 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== d Jun 30 12:54:19.850138320 (171h42m46.776433013s) [upload=137567]: Done starting upload Jun 30 12:54:19.850241473 (171h42m46.776536145s) [upload=137567]: Uploading segments... Jun 30 12:54:19.850313152 (171h42m46.776607837s) [upload=137567]: Got next segment. Inline: true Jun 30 12:54:19.850318448 (171h42m46.77661312s) [upload=137567]: Waiting for error group managing segments... Jun 30 12:54:19.850368162 (171h42m46.776662835s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:54:19.850372886 (171h42m46.776667575s) [upload=137567]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:54:19.850375400 (171h42m46.776670087s) [upload=137567]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:54:19.911523047 (171h42m46.837817726s) [upload=137567]: Done uploading segments... Jun 30 12:54:19.911541941 (171h42m46.837836618s) [upload=137567]: Upload finished. err: <nil> Jun 30 12:55:14.438201539 (171h43m41.364496235s) [upload=137578]: Starting upload Jun 30 12:55:14.438325583 (171h43m41.364620279s) [upload=137578]: Done starting upload Jun 30 12:55:14.438440296 (171h43m41.364734972s) [upload=137578]: Uploading segments... Jun 30 12:55:14.438524918 (171h43m41.364819617s) [upload=137578]: Got next segment. Inline: true Jun 30 12:55:14.438531595 (171h43m41.364826287s) [upload=137578]: Waiting for error group managing segments... Jun 30 12:55:14.438607364 (171h43m41.364902051s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:55:14.438614483 (171h43m41.364909182s) [upload=137578]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:55:14.438637734 (171h43m41.364932427s) [upload=137578]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:55:14.507628041 (171h43m41.433922728s) [upload=137578]: Done uploading segments... Jun 30 12:55:14.507647379 (171h43m41.433942067s) [upload=137578]: Upload finished. err: <nil> Jun 30 12:56:28.469068898 (171h44m55.395363575s) [upload=137597]: Starting upload Jun 30 12:56:28.469154033 (171h44m55.39544872s) [upload=137597]: Done starting upload Jun 30 12:56:28.469274901 (171h44m55.395569581s) [upload=137597]: Uploading segments... Jun 30 12:56:28.469340887 (171h44m55.395635579s) [upload=137597]: Got next segment. Inline: true Jun 30 12:56:28.469347443 (171h44m55.395642145s) [upload=137597]: Waiting for error group managing segments... Jun 30 12:56:28.469395314 (171h44m55.395689989s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:28.469401443 (171h44m55.39569614s) [upload=137597]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:28.469420816 (171h44m55.395715511s) [upload=137597]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:28.535555260 (171h44m55.461849953s) [upload=137597]: Done uploading segments... Jun 30 12:56:28.535578413 (171h44m55.4618731s) [upload=137597]: Upload finished. err: <nil> Jun 30 12:56:59.517942990 (171h45m26.444237667s) [upload=137606]: Starting upload Jun 30 12:56:59.518029091 (171h45m26.444323777s) [upload=137606]: Done starting upload Jun 30 12:56:59.518101407 (171h45m26.444396087s) [upload=137606]: Uploading segments... Jun 30 12:56:59.518152328 (171h45m26.444447015s) [upload=137606]: Got next segment. Inline: true Jun 30 12:56:59.518157720 (171h45m26.444452396s) [upload=137606]: Waiting for error group managing segments... Jun 30 12:56:59.518203247 (171h45m26.44449793s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:56:59.518209643 (171h45m26.444504339s) [upload=137606]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:56:59.518213905 (171h45m26.444508599s) [upload=137606]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:56:59.578374956 (171h45m26.504669634s) [upload=137606]: Done uploading segments... Jun 30 12:56:59.578393825 (171h45m26.504688501s) [upload=137606]: Upload finished. err: <nil> Jun 30 12:58:04.707109173 (171h46m31.633403874s) [upload=137618]: Starting upload Jun 30 12:58:04.707213400 (171h46m31.633508077s) [upload=137618]: Done starting upload Jun 30 12:58:04.707318070 (171h46m31.633612756s) [upload=137618]: Uploading segments... Jun 30 12:58:04.707406228 (171h46m31.633700924s) [upload=137618]: Got next segment. Inline: true Jun 30 12:58:04.707414472 (171h46m31.633709162s) [upload=137618]: Waiting for error group managing segments... Jun 30 12:58:04.707474429 (171h46m31.633769131s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:04.707483954 (171h46m31.633778647s) [upload=137618]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:04.707487985 (171h46m31.633782659s) [upload=137618]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:04.767340193 (171h46m31.693634871s) [upload=137618]: Done uploading segments... Jun 30 12:58:04.767359969 (171h46m31.693654645s) [upload=137618]: Upload finished. err: <nil> Jun 30 12:58:50.949783376 (171h47m17.876078066s) [upload=137628]: Starting upload Jun 30 12:58:50.949880041 (171h47m17.876174732s) [upload=137628]: Done starting upload Jun 30 12:58:50.949933739 (171h47m17.876228446s) [upload=137628]: Uploading segments... Jun 30 12:58:50.950028886 (171h47m17.876323601s) [upload=137628]: Got next segment. Inline: true Jun 30 12:58:50.950035168 (171h47m17.876329856s) [upload=137628]: Waiting for error group managing segments... Jun 30 12:58:50.950106062 (171h47m17.876400749s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:58:50.950112055 (171h47m17.876406745s) [upload=137628]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:58:50.950115378 (171h47m17.876410067s) [upload=137628]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:58:51.011323384 (171h47m17.937618071s) [upload=137628]: Done uploading segments... Jun 30 12:58:51.011341547 (171h47m17.937636233s) [upload=137628]: Upload finished. err: <nil> Jun 30 12:59:34.511701359 (171h48m1.437996035s) [upload=137636]: Starting upload Jun 30 12:59:34.511772591 (171h48m1.438067281s) [upload=137636]: Done starting upload Jun 30 12:59:34.511851823 (171h48m1.438146503s) [upload=137636]: Uploading segments... Jun 30 12:59:34.511902891 (171h48m1.438197587s) [upload=137636]: Got next segment. Inline: true Jun 30 12:59:34.511909364 (171h48m1.438204053s) [upload=137636]: Waiting for error group managing segments... Jun 30 12:59:34.511979666 (171h48m1.438274356s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 12:59:34.511986952 (171h48m1.438281642s) [upload=137636]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 12:59:34.511991804 (171h48m1.438286495s) [upload=137636]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 12:59:34.592474584 (171h48m1.518769271s) [upload=137636]: Done uploading segments... Jun 30 12:59:34.592493677 (171h48m1.518788365s) [upload=137636]: Upload finished. err: <nil> Jun 30 13:00:11.879387252 (171h48m38.805681951s) [upload=137646]: Starting upload Jun 30 13:00:11.879540320 (171h48m38.80583502s) [upload=137646]: Done starting upload Jun 30 13:00:11.879694893 (171h48m38.805989587s) [upload=137646]: Uploading segments... Jun 30 13:00:11.879754809 (171h48m38.806049537s) [upload=137646]: Got next segment. Inline: true Jun 30 13:00:11.879763286 (171h48m38.806057987s) [upload=137646]: Waiting for error group managing segments... Jun 30 13:00:11.879824566 (171h48m38.806119266s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:11.879832262 (171h48m38.806126962s) [upload=137646]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:11.879837709 (171h48m38.806132408s) [upload=137646]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:11.958618186 (171h48m38.884912881s) [upload=137646]: Done uploading segments... Jun 30 13:00:11.958656359 (171h48m38.88495105s) [upload=137646]: Upload finished. err: <nil> Jun 30 13:00:50.309066462 (171h49m17.235361161s) [upload=137657]: Starting upload Jun 30 13:00:50.309174902 (171h49m17.235469599s) [upload=137657]: Done starting upload Jun 30 13:00:50.309302655 (171h49m17.235597328s) [upload=137657]: Uploading segments... Jun 30 13:00:50.309368898 (171h49m17.235663596s) [upload=137657]: Got next segment. Inline: true Jun 30 13:00:50.309376118 (171h49m17.235670806s) [upload=137657]: Waiting for error group managing segments... Jun 30 13:00:50.309435031 (171h49m17.23572973s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:00:50.309443084 (171h49m17.235737783s) [upload=137657]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:00:50.309448071 (171h49m17.235742764s) [upload=137657]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:00:50.367871760 (171h49m17.294166502s) [upload=137657]: Done uploading segments... Jun 30 13:00:50.367898080 (171h49m17.294192774s) [upload=137657]: Upload finished. err: <nil> Jun 30 13:01:24.497976188 (171h49m51.424270881s) [upload=137664]: Starting upload Jun 30 13:01:24.498096801 (171h49m51.424391499s) [upload=137664]: Done starting upload Jun 30 13:01:24.498224405 (171h49m51.424519094s) [upload=137664]: Uploading segments... Jun 30 13:01:24.498280720 (171h49m51.424575419s) [upload=137664]: Got next segment. Inline: true Jun 30 13:01:24.498287957 (171h49m51.424582647s) [upload=137664]: Waiting for error group managing segments... Jun 30 13:01:24.498343604 (171h49m51.424638282s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 30 13:01:24.498350223 (171h49m51.424644899s) [upload=137664]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jun 30 13:01:24.498354841 (171h49m51.424649519s) [upload=137664]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 30 13:01:24.590965607 (171h49m51.517260306s) [upload=137664]: Done uploading segments... Jun 30 13:01:24.590989415 (171h49m51.51728411s) [upload=137664]: Upload finished. err: <nil> Duration: 232.084873ms core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)