Orbiter History

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 2 out of 15 is failed (threshold=6) [............XX.] duration: 131.029059ms target: https://www.tardigrade.io/ FAIL (2025-07-14 22:23:32 UTC) orbiter warning: Get "https://www.tardigrade.io/": dial tcp: lookup www.tardigrade.io on 127.0.0.1:53: read udp 127.0.0.1:42432->127.0.0.1:53: i/o timeout Duration: 131.054075ms core website
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [...........................................................X] duration: 10.002060709s target: https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt FAIL (2025-07-14 22:23:17 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": dial tcp: lookup link.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:45523->127.0.0.1:53: i/o timeout Duration: 10.00208185s edge linksharing bgp eu1
checkers.HTTP{"GET" "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt", ExpectedStatus: 308, ExpectedRedirect: "https://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt"} failure (antiblip window 3/60): (http.us_select_1.linksharing) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 10.001635515s target: http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt FAIL (2025-07-14 22:23:06 UTC) orbiter warning: Get "http://link.us-select-1.storjshare.io/raw/jv6fvdi5muos6nw22tdksxgfrd2a/uptime-checks-us-select/hello-world.txt": dial tcp: lookup link.us-select-1.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:54407->127.0.0.1:53: i/o timeout Duration: 10.001660346s edge linksharing us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [...........................................................X] duration: 1.059178389s target: https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt FAIL (2025-07-14 22:23:06 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt": dial tcp: lookup link.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:39950->127.0.0.1:53: i/o timeout Duration: 1.059258296s edge linksharing bgp us1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [...........................................................X] duration: 10.001660071s target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt FAIL (2025-07-14 22:23:06 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": dial tcp: lookup link.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:39950->127.0.0.1:53: i/o timeout Duration: 10.001689186s edge linksharing bgp ap1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 645.462489ms FAIL (2025-07-14 22:23:04 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:51614->127.0.0.1:53: i/o timeout Duration: 645.495234ms core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 2 out of 15 is failed (threshold=6) [.............XX] duration: 10.002158111s target: https://www.tardigrade.io/ FAIL (2025-07-14 22:22:53 UTC) orbiter warning: Get "https://www.tardigrade.io/": dial tcp: lookup www.tardigrade.io on 127.0.0.1:53: read udp 127.0.0.1:42432->127.0.0.1:53: i/o timeout Duration: 10.002180684s core website
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 10.001855699s FAIL (2025-07-14 22:22:45 UTC) orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp: lookup auth.storjshare.io on 127.0.0.1:53: read udp 127.0.0.1:51614->127.0.0.1:53: i/o timeout Duration: 10.001885381s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io) antiblip: 1 out of 15 is failed (threshold=6) [..............X] duration: 10.001868057s target: https://www.tardigrade.io/ FAIL (2025-07-14 22:22:26 UTC) orbiter warning: Get "https://www.tardigrade.io/": dial tcp: lookup www.tardigrade.io on 127.0.0.1:53: read udp 127.0.0.1:55101->127.0.0.1:53: i/o timeout Duration: 10.001894429s core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 221.562151ms FAIL (2025-07-14 16:44:34 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 221.591739ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 243.13423ms FAIL (2025-07-14 16:43:27 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 243.176363ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 263.393329ms FAIL (2025-07-14 16:42:34 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 263.4437ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 224.659936ms FAIL (2025-07-14 16:41:45 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 224.696518ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 256.331995ms FAIL (2025-07-14 16:40:34 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 256.362139ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 421.317954ms FAIL (2025-07-14 16:39:54 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 421.356211ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 296.686974ms FAIL (2025-07-14 16:38:39 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 296.730953ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 284.061878ms FAIL (2025-07-14 16:37:43 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 284.166125ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 403.333622ms FAIL (2025-07-14 16:37:14 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 403.360796ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 236.247883ms FAIL (2025-07-14 16:36:49 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 236.346565ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 274.857865ms FAIL (2025-07-14 16:36:02 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 274.897469ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 437.937082ms FAIL (2025-07-14 16:35:13 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 437.964231ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 278.973487ms FAIL (2025-07-14 16:34:35 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 279.059182ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 269.222456ms FAIL (2025-07-14 16:33:54 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 269.254606ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 223.798965ms FAIL (2025-07-14 16:33:06 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 223.820317ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 240.298877ms FAIL (2025-07-14 16:32:27 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 240.426383ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 260.119526ms FAIL (2025-07-14 16:31:44 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 260.151766ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 266.573736ms FAIL (2025-07-14 16:31:16 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 266.605339ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 274.576736ms FAIL (2025-07-14 16:30:36 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 274.611184ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 276.98708ms FAIL (2025-07-14 16:29:35 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 277.015919ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 270.393126ms FAIL (2025-07-14 16:28:36 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 270.424635ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 313.353061ms FAIL (2025-07-14 16:28:17 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 313.393167ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 452.970089ms FAIL (2025-07-14 16:27:43 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 452.998352ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 233.166002ms FAIL (2025-07-14 16:27:24 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 233.212261ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 275.11049ms FAIL (2025-07-14 16:26:29 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 275.142623ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 267.318232ms FAIL (2025-07-14 16:25:40 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 267.342967ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 238.58834ms FAIL (2025-07-14 16:24:57 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 238.663045ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 250.873812ms FAIL (2025-07-14 16:24:33 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 250.951101ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 221.905003ms FAIL (2025-07-14 16:24:09 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 221.930122ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 255.949006ms FAIL (2025-07-14 16:23:30 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 255.98159ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 224.011319ms FAIL (2025-07-14 16:22:23 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 224.06821ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 272.102693ms FAIL (2025-07-14 16:21:47 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 272.123644ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 292.847498ms FAIL (2025-07-14 16:21:23 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 292.878464ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 250.097228ms FAIL (2025-07-14 16:20:31 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 250.119897ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 228.791948ms FAIL (2025-07-14 16:19:26 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 228.826126ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 300.428626ms FAIL (2025-07-14 16:18:47 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 300.455661ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 379.260447ms FAIL (2025-07-14 16:18:00 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 379.30714ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 270.471175ms FAIL (2025-07-14 16:17:29 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 270.501509ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 238.011222ms FAIL (2025-07-14 16:16:44 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 238.03574ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 271.668753ms FAIL (2025-07-14 16:16:27 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 271.718991ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 544.104663ms FAIL (2025-07-14 16:15:24 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Starting upload Jul 14 15:55:08.565241979 (510h43m35.491536651s) [upload=408757]: Done starting upload Jul 14 15:55:08.565400991 (510h43m35.491695678s) [upload=408757]: Uploading segments... Jul 14 15:55:08.565544163 (510h43m35.491838864s) [upload=408757]: Got next segment. Inline: true Jul 14 15:55:08.565552872 (510h43m35.491847572s) [upload=408757]: Waiting for error group managing segments... Jul 14 15:55:08.565634353 (510h43m35.491929047s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:55:08.565641501 (510h43m35.491936199s) [upload=408757]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:55:08.565645907 (510h43m35.491940602s) [upload=408757]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:55:08.811788722 (510h43m35.738083419s) [upload=408757]: Done uploading segments... Jul 14 15:55:08.811812270 (510h43m35.738106947s) [upload=408757]: Upload finished. err: <nil> Jul 14 15:56:05.100227897 (510h44m32.026522596s) [upload=408769]: Starting upload Jul 14 15:56:05.100312658 (510h44m32.026607363s) [upload=408769]: Done starting upload Jul 14 15:56:05.100408970 (510h44m32.026703651s) [upload=408769]: Uploading segments... Jul 14 15:56:05.100472989 (510h44m32.026767692s) [upload=408769]: Got next segment. Inline: true Jul 14 15:56:05.100481607 (510h44m32.026776311s) [upload=408769]: Waiting for error group managing segments... Jul 14 15:56:05.100545751 (510h44m32.02684045s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:05.100552351 (510h44m32.026847052s) [upload=408769]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:05.100556814 (510h44m32.026851531s) [upload=408769]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:05.182190284 (510h44m32.108484963s) [upload=408769]: Done uploading segments... Jul 14 15:56:05.182214367 (510h44m32.108509041s) [upload=408769]: Upload finished. err: <nil> Jul 14 15:56:23.561600009 (510h44m50.487894682s) [upload=408772]: Starting upload Jul 14 15:56:23.561697683 (510h44m50.487992369s) [upload=408772]: Done starting upload Jul 14 15:56:23.561763634 (510h44m50.488058306s) [upload=408772]: Uploading segments... Jul 14 15:56:23.561805939 (510h44m50.488100634s) [upload=408772]: Got next segment. Inline: true Jul 14 15:56:23.561810017 (510h44m50.488104688s) [upload=408772]: Waiting for error group managing segments... Jul 14 15:56:23.561847407 (510h44m50.488142079s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:56:23.561851632 (510h44m50.488146304s) [upload=408772]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:56:23.561854076 (510h44m50.488148748s) [upload=408772]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:56:23.793680582 (510h44m50.719975274s) [upload=408772]: Done uploading segments... Jul 14 15:56:23.793703117 (510h44m50.719997812s) [upload=408772]: Upload finished. err: <nil> Jul 14 15:57:34.519878119 (510h46m1.446172811s) [upload=408788]: Starting upload Jul 14 15:57:34.519970480 (510h46m1.446265177s) [upload=408788]: Done starting upload Jul 14 15:57:34.520092411 (510h46m1.446387099s) [upload=408788]: Uploading segments... Jul 14 15:57:34.520166251 (510h46m1.446460944s) [upload=408788]: Got next segment. Inline: true Jul 14 15:57:34.520172205 (510h46m1.446466896s) [upload=408788]: Waiting for error group managing segments... Jul 14 15:57:34.520234530 (510h46m1.44652922s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:57:34.520242554 (510h46m1.446537246s) [upload=408788]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:57:34.520246414 (510h46m1.446541089s) [upload=408788]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:57:34.591357941 (510h46m1.51765263s) [upload=408788]: Done uploading segments... Jul 14 15:57:34.591382458 (510h46m1.51767713s) [upload=408788]: Upload finished. err: <nil> Jul 14 15:58:21.181278288 (510h46m48.107572974s) [upload=408799]: Starting upload Jul 14 15:58:21.181414723 (510h46m48.10770941s) [upload=408799]: Done starting upload Jul 14 15:58:21.181504668 (510h46m48.107799344s) [upload=408799]: Uploading segments... Jul 14 15:58:21.181594057 (510h46m48.107888743s) [upload=408799]: Got next segment. Inline: true Jul 14 15:58:21.181599968 (510h46m48.107894655s) [upload=408799]: Waiting for error group managing segments... Jul 14 15:58:21.181655490 (510h46m48.107950176s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:58:21.181663575 (510h46m48.107958267s) [upload=408799]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:58:21.181666950 (510h46m48.107961639s) [upload=408799]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:58:21.254313332 (510h46m48.180608024s) [upload=408799]: Done uploading segments... Jul 14 15:58:21.254337414 (510h46m48.180632092s) [upload=408799]: Upload finished. err: <nil> Jul 14 15:59:29.757582463 (510h47m56.683877164s) [upload=408811]: Starting upload Jul 14 15:59:29.757667050 (510h47m56.683961743s) [upload=408811]: Done starting upload Jul 14 15:59:29.757746038 (510h47m56.684040714s) [upload=408811]: Uploading segments... Jul 14 15:59:29.757796482 (510h47m56.68409118s) [upload=408811]: Got next segment. Inline: true Jul 14 15:59:29.757801821 (510h47m56.684096513s) [upload=408811]: Waiting for error group managing segments... Jul 14 15:59:29.757848310 (510h47m56.684143003s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 15:59:29.757855707 (510h47m56.684150406s) [upload=408811]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 15:59:29.757859794 (510h47m56.684154486s) [upload=408811]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 15:59:29.825119607 (510h47m56.751414299s) [upload=408811]: Done uploading segments... Jul 14 15:59:29.825142445 (510h47m56.751437135s) [upload=408811]: Upload finished. err: <nil> Jul 14 16:00:11.648463355 (510h48m38.574758053s) [upload=408818]: Starting upload Jul 14 16:00:11.648621094 (510h48m38.57491579s) [upload=408818]: Done starting upload Jul 14 16:00:11.648755961 (510h48m38.575050645s) [upload=408818]: Uploading segments... Jul 14 16:00:11.648856115 (510h48m38.575150812s) [upload=408818]: Got next segment. Inline: true Jul 14 16:00:11.648863578 (510h48m38.575158271s) [upload=408818]: Waiting for error group managing segments... Jul 14 16:00:11.648968244 (510h48m38.575262941s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:11.648976013 (510h48m38.575270714s) [upload=408818]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:11.648980488 (510h48m38.575275181s) [upload=408818]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:11.720172712 (510h48m38.646467402s) [upload=408818]: Done uploading segments... Jul 14 16:00:11.720203386 (510h48m38.64649808s) [upload=408818]: Upload finished. err: <nil> Jul 14 16:00:39.684063309 (510h49m6.610358001s) [upload=408823]: Starting upload Jul 14 16:00:39.684197216 (510h49m6.610491914s) [upload=408823]: Done starting upload Jul 14 16:00:39.684330531 (510h49m6.610625206s) [upload=408823]: Uploading segments... Jul 14 16:00:39.684417335 (510h49m6.610712035s) [upload=408823]: Got next segment. Inline: true Jul 14 16:00:39.684424166 (510h49m6.610718864s) [upload=408823]: Waiting for error group managing segments... Jul 14 16:00:39.684496816 (510h49m6.610791513s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:00:39.684503739 (510h49m6.610798429s) [upload=408823]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:00:39.684507835 (510h49m6.610802532s) [upload=408823]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:00:39.773228188 (510h49m6.69952288s) [upload=408823]: Done uploading segments... Jul 14 16:00:39.773253855 (510h49m6.699548536s) [upload=408823]: Upload finished. err: <nil> Jul 14 16:01:22.423898202 (510h49m49.35019288s) [upload=408833]: Starting upload Jul 14 16:01:22.423960020 (510h49m49.3502547s) [upload=408833]: Done starting upload Jul 14 16:01:22.424032216 (510h49m49.350326893s) [upload=408833]: Uploading segments... Jul 14 16:01:22.424072024 (510h49m49.350366719s) [upload=408833]: Got next segment. Inline: true Jul 14 16:01:22.424077241 (510h49m49.350371918s) [upload=408833]: Waiting for error group managing segments... Jul 14 16:01:22.424119904 (510h49m49.35041458s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:01:22.424125156 (510h49m49.350419842s) [upload=408833]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:01:22.424128672 (510h49m49.350423359s) [upload=408833]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:01:22.497137586 (510h49m49.423432279s) [upload=408833]: Done uploading segments... Jul 14 16:01:22.497176352 (510h49m49.423471058s) [upload=408833]: Upload finished. err: <nil> Jul 14 16:02:26.270217585 (510h50m53.196512262s) [upload=408846]: Starting upload Jul 14 16:02:26.270296932 (510h50m53.19659161s) [upload=408846]: Done starting upload Jul 14 16:02:26.270409290 (510h50m53.196703967s) [upload=408846]: Uploading segments... Jul 14 16:02:26.270448175 (510h50m53.196742869s) [upload=408846]: Got next segment. Inline: true Jul 14 16:02:26.270466493 (510h50m53.196761179s) [upload=408846]: Waiting for error group managing segments... Jul 14 16:02:26.270512654 (510h50m53.196807329s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 14 16:02:26.270517616 (510h50m53.196812297s) [upload=408846]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Jul 14 16:02:26.270520833 (510h50m53.196815519s) [upload=408846]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 14 16:02:26.384583512 (510h50m53.310878197s) [upload=408846]: Done uploading segments... Jul 14 16:02:26.384604960 (510h50m53.310899636s) [upload=408846]: Upload finished. err: <nil> Duration: 544.140916ms core uplink us-select-1

Orbiter Check History

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jw7f74fzbtwblz3mwqolmnivikxq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.us1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.HTTP{"GET" "https://www.tardigrade.io/", ExpectedStatus: 301, ExpectedRedirect: "https://www.storj.io/"} failure (antiblip window 6/15): (http.tardigrade_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)