Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 459.548043ms trace: https://jaeger.dev.storj.io/trace/535d44beeeafe52a FAIL (2025-12-08 17:06:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 8 17:02:48.738023080 (73h34m49.565731479s) [upload=76480]: Starting upload Dec 8 17:02:48.738095838 (73h34m49.565804247s) [upload=76480]: Done starting upload Dec 8 17:02:48.738417931 (73h34m49.566126324s) [upload=76480]: Uploading segments... Dec 8 17:02:48.738470600 (73h34m49.566179003s) [upload=76480]: Got next segment. Inline: false Dec 8 17:02:48.738517579 (73h34m49.56622597s) [upload=76480]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 17:02:48.738523576 (73h34m49.566231968s) [upload=76480]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 17:02:48.769802661 (73h34m49.597511053s) [seg_pos={0 0}, upload=76480]: Begin upload segment... Dec 8 17:02:48.769865494 (73h34m49.597573886s) [seg_pos={0 0}, upload=76480]: Done begin upload segment. Dec 8 17:02:48.769907136 (73h34m49.597615538s) [noise=true , address=145.79.227.26:4654 , piece_id=2FHPIZA5BL7Q4JQQZE56KLIUKCNUW7CUARG72SP4Q7YBLEV7VA7A, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.769939359 (73h34m49.597647766s) [noise=true , address=77.90.31.13:4628 , piece_id=LTI5XLVJMTZ2U373UX2L4AMJEILTDR2PYFQBAF5DKEVNQSKD5CXA, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.770462858 (73h34m49.598171256s) [noise=true , address=145.79.227.12:4765 , piece_id=R6SQ4SBMCWD4DKP4FAGLPUMSOA4KRF4F2AML2TV464ZYIQ537JFA, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.770592023 (73h34m49.59830042s) [noise=true , address=145.79.227.34:4907 , piece_id=YGIATRQPO6ZWFZD45CSFBSVL7L3DRNGIC5RJGPPOV6CSNXDNEDLQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.770900372 (73h34m49.598608765s) [noise=true , address=145.79.227.23:4546 , piece_id=L2UX5LJADQOQVS7ZKHBOTHKZNXXV22W4UJ3OUGCSHWUDMHT4EYRA, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.770964143 (73h34m49.598672541s) [noise=true , address=77.90.31.21:4877 , piece_id=3B56C74MQDSFAXO5SAZ2BG2QMHZZWSOX2BW3DACVRYW6F2QKDMQQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.771340212 (73h34m49.599048606s) [noise=true , address=145.79.227.41:4086 , piece_id=QVKEINCWGAGSEBYCFWPHLGVDRLQLVT35LZCCCYF3VSKTWLY5EYRQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.771369877 (73h34m49.599078273s) [noise=true , address=145.79.227.27:4690 , piece_id=IWPD3QZEMPXRZVSDS7S6UEIHELJEVVWIECBE527FNIF25ZG2NP2Q, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.771701791 (73h34m49.599410175s) [noise=true , address=145.79.227.29:4941 , piece_id=P2Z5FPJDTTTKH3ZL4UU3JW6NC2VJ34RG4CIMAXRW6Z5EZPHUQQ6Q, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.771839972 (73h34m49.599548367s) [noise=true , address=145.79.227.22:4510 , piece_id=KVY33OABWKC4AHQXGQ2QQZBB6TNGSSSR4ZOZN56NHBGGBJUQEYLQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.772466849 (73h34m49.600175247s) [noise=true , address=77.90.31.13:4627 , piece_id=DCNTHYBRJN5Q2IWGPKRQ7LEKYCSXOQSLQ5GI4YGPNGVQINLQKIYQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.772890389 (73h34m49.600598785s) [noise=true , address=145.79.227.6:4257 , piece_id=IKR5EZUXWCEVA5SQ7546KXSKWTBDYQJ7AMTVXX2T25IOOMW2TKCQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.773397195 (73h34m49.601105589s) [noise=true , address=145.79.227.28:4726 , piece_id=SBWY4VB3BN65MOVJO22NIR2HN7CS63ODABH4XH3O55NDHCCMCM2A, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.773517775 (73h34m49.601226156s) [noise=true , address=77.90.31.12:4589 , piece_id=LJUT5EHGQZJYA2AS5S53CJULTOK4LQYV3ZDZUJAFXLIY3BPO3SFQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.773954120 (73h34m49.601662518s) [noise=true , address=145.79.227.24:4583 , piece_id=VWEGXRGYJXX7H75WUTBDZFZ3HPR74VPII4K6SJPBFV62FCXS5JIQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.774310139 (73h34m49.602018536s) [noise=true , address=145.79.227.23:4547 , piece_id=FKELFFQLGRPRX5L7FKMDZPOTBDHMKQDP6HJQUYLUDVMXOSKIMXGA, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.799192405 (73h34m49.626900805s) [noise=true , address=77.90.31.13:4628 , piece_id=LTI5XLVJMTZ2U373UX2L4AMJEILTDR2PYFQBAF5DKEVNQSKD5CXA, seg_pos={0 0}, upload=76480]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: storage node overloaded, request limit: 2000 Dec 8 17:02:48.799876711 (73h34m49.627585112s) [noise=true , address=77.90.31.12:4589 , piece_id=LJUT5EHGQZJYA2AS5S53CJULTOK4LQYV3ZDZUJAFXLIY3BPO3SFQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: storage node overloaded, request limit: 2000 Dec 8 17:02:48.807505994 (73h34m49.635214394s) [noise=true , address=77.90.31.21:4877 , piece_id=3B56C74MQDSFAXO5SAZ2BG2QMHZZWSOX2BW3DACVRYW6F2QKDMQQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: storage node overloaded, request limit: 2000 Dec 8 17:02:48.845983839 (73h34m49.673692221s) [upload=76480]: Next returned nil segment Dec 8 17:02:48.845997556 (73h34m49.673705948s) [upload=76480]: Waiting for error group managing segments... Dec 8 17:02:48.853006781 (73h34m49.680715171s) [noise=true , address=145.79.227.6:4257 , piece_id=IKR5EZUXWCEVA5SQ7546KXSKWTBDYQJ7AMTVXX2T25IOOMW2TKCQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.853644007 (73h34m49.681352402s) [noise=true , address=145.79.227.12:4765 , piece_id=R6SQ4SBMCWD4DKP4FAGLPUMSOA4KRF4F2AML2TV464ZYIQ537JFA, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.856107946 (73h34m49.68381634s) [noise=true , address=145.79.227.22:4510 , piece_id=KVY33OABWKC4AHQXGQ2QQZBB6TNGSSSR4ZOZN56NHBGGBJUQEYLQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.856510829 (73h34m49.684219222s) [noise=true , address=145.79.227.26:4654 , piece_id=2FHPIZA5BL7Q4JQQZE56KLIUKCNUW7CUARG72SP4Q7YBLEV7VA7A, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.856772442 (73h34m49.684480837s) [noise=true , address=145.79.227.34:4907 , piece_id=YGIATRQPO6ZWFZD45CSFBSVL7L3DRNGIC5RJGPPOV6CSNXDNEDLQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.856975680 (73h34m49.684684071s) [noise=true , address=145.79.227.29:4941 , piece_id=P2Z5FPJDTTTKH3ZL4UU3JW6NC2VJ34RG4CIMAXRW6Z5EZPHUQQ6Q, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.857242047 (73h34m49.68495045s) [noise=true , address=145.79.227.24:4583 , piece_id=VWEGXRGYJXX7H75WUTBDZFZ3HPR74VPII4K6SJPBFV62FCXS5JIQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.857377588 (73h34m49.68508598s) [noise=true , address=145.79.227.28:4726 , piece_id=SBWY4VB3BN65MOVJO22NIR2HN7CS63ODABH4XH3O55NDHCCMCM2A, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.857752465 (73h34m49.68546086s) [noise=true , address=145.79.227.23:4547 , piece_id=FKELFFQLGRPRX5L7FKMDZPOTBDHMKQDP6HJQUYLUDVMXOSKIMXGA, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.857759093 (73h34m49.685467489s) [noise=true , address=145.79.227.23:4546 , piece_id=L2UX5LJADQOQVS7ZKHBOTHKZNXXV22W4UJ3OUGCSHWUDMHT4EYRA, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.858219382 (73h34m49.685927774s) [noise=true , address=145.79.227.27:4690 , piece_id=IWPD3QZEMPXRZVSDS7S6UEIHELJEVVWIECBE527FNIF25ZG2NP2Q, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.859176521 (73h34m49.686884917s) [noise=true , address=145.79.227.41:4086 , piece_id=QVKEINCWGAGSEBYCFWPHLGVDRLQLVT35LZCCCYF3VSKTWLY5EYRQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:03:18.698437167 (73h35m19.526145561s) [noise=true , address=77.90.31.13:4627 , piece_id=DCNTHYBRJN5Q2IWGPKRQ7LEKYCSXOQSLQ5GI4YGPNGVQINLQKIYQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: expected piece hash; context deadline exceeded; EOF Dec 8 17:03:18.698506535 (73h35m19.526214917s) [seg_pos={0 0}, upload=76480]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 8 17:03:18.724186991 (73h35m19.551895387s) [upload=76480]: Done uploading segments... Dec 8 17:03:18.724296376 (73h35m19.552004781s) [upload=76480]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 459.57813ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 503.462481ms trace: https://jaeger.dev.storj.io/trace/535d44beeeafe52a FAIL (2025-12-08 17:05:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 8 17:02:48.738023080 (73h34m49.565731479s) [upload=76480]: Starting upload Dec 8 17:02:48.738095838 (73h34m49.565804247s) [upload=76480]: Done starting upload Dec 8 17:02:48.738417931 (73h34m49.566126324s) [upload=76480]: Uploading segments... Dec 8 17:02:48.738470600 (73h34m49.566179003s) [upload=76480]: Got next segment. Inline: false Dec 8 17:02:48.738517579 (73h34m49.56622597s) [upload=76480]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 17:02:48.738523576 (73h34m49.566231968s) [upload=76480]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 17:02:48.769802661 (73h34m49.597511053s) [seg_pos={0 0}, upload=76480]: Begin upload segment... Dec 8 17:02:48.769865494 (73h34m49.597573886s) [seg_pos={0 0}, upload=76480]: Done begin upload segment. Dec 8 17:02:48.769907136 (73h34m49.597615538s) [noise=true , address=145.79.227.26:4654 , piece_id=2FHPIZA5BL7Q4JQQZE56KLIUKCNUW7CUARG72SP4Q7YBLEV7VA7A, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.769939359 (73h34m49.597647766s) [noise=true , address=77.90.31.13:4628 , piece_id=LTI5XLVJMTZ2U373UX2L4AMJEILTDR2PYFQBAF5DKEVNQSKD5CXA, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.770462858 (73h34m49.598171256s) [noise=true , address=145.79.227.12:4765 , piece_id=R6SQ4SBMCWD4DKP4FAGLPUMSOA4KRF4F2AML2TV464ZYIQ537JFA, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.770592023 (73h34m49.59830042s) [noise=true , address=145.79.227.34:4907 , piece_id=YGIATRQPO6ZWFZD45CSFBSVL7L3DRNGIC5RJGPPOV6CSNXDNEDLQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.770900372 (73h34m49.598608765s) [noise=true , address=145.79.227.23:4546 , piece_id=L2UX5LJADQOQVS7ZKHBOTHKZNXXV22W4UJ3OUGCSHWUDMHT4EYRA, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.770964143 (73h34m49.598672541s) [noise=true , address=77.90.31.21:4877 , piece_id=3B56C74MQDSFAXO5SAZ2BG2QMHZZWSOX2BW3DACVRYW6F2QKDMQQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.771340212 (73h34m49.599048606s) [noise=true , address=145.79.227.41:4086 , piece_id=QVKEINCWGAGSEBYCFWPHLGVDRLQLVT35LZCCCYF3VSKTWLY5EYRQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.771369877 (73h34m49.599078273s) [noise=true , address=145.79.227.27:4690 , piece_id=IWPD3QZEMPXRZVSDS7S6UEIHELJEVVWIECBE527FNIF25ZG2NP2Q, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.771701791 (73h34m49.599410175s) [noise=true , address=145.79.227.29:4941 , piece_id=P2Z5FPJDTTTKH3ZL4UU3JW6NC2VJ34RG4CIMAXRW6Z5EZPHUQQ6Q, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.771839972 (73h34m49.599548367s) [noise=true , address=145.79.227.22:4510 , piece_id=KVY33OABWKC4AHQXGQ2QQZBB6TNGSSSR4ZOZN56NHBGGBJUQEYLQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.772466849 (73h34m49.600175247s) [noise=true , address=77.90.31.13:4627 , piece_id=DCNTHYBRJN5Q2IWGPKRQ7LEKYCSXOQSLQ5GI4YGPNGVQINLQKIYQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.772890389 (73h34m49.600598785s) [noise=true , address=145.79.227.6:4257 , piece_id=IKR5EZUXWCEVA5SQ7546KXSKWTBDYQJ7AMTVXX2T25IOOMW2TKCQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.773397195 (73h34m49.601105589s) [noise=true , address=145.79.227.28:4726 , piece_id=SBWY4VB3BN65MOVJO22NIR2HN7CS63ODABH4XH3O55NDHCCMCM2A, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.773517775 (73h34m49.601226156s) [noise=true , address=77.90.31.12:4589 , piece_id=LJUT5EHGQZJYA2AS5S53CJULTOK4LQYV3ZDZUJAFXLIY3BPO3SFQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.773954120 (73h34m49.601662518s) [noise=true , address=145.79.227.24:4583 , piece_id=VWEGXRGYJXX7H75WUTBDZFZ3HPR74VPII4K6SJPBFV62FCXS5JIQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.774310139 (73h34m49.602018536s) [noise=true , address=145.79.227.23:4547 , piece_id=FKELFFQLGRPRX5L7FKMDZPOTBDHMKQDP6HJQUYLUDVMXOSKIMXGA, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.799192405 (73h34m49.626900805s) [noise=true , address=77.90.31.13:4628 , piece_id=LTI5XLVJMTZ2U373UX2L4AMJEILTDR2PYFQBAF5DKEVNQSKD5CXA, seg_pos={0 0}, upload=76480]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: storage node overloaded, request limit: 2000 Dec 8 17:02:48.799876711 (73h34m49.627585112s) [noise=true , address=77.90.31.12:4589 , piece_id=LJUT5EHGQZJYA2AS5S53CJULTOK4LQYV3ZDZUJAFXLIY3BPO3SFQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: storage node overloaded, request limit: 2000 Dec 8 17:02:48.807505994 (73h34m49.635214394s) [noise=true , address=77.90.31.21:4877 , piece_id=3B56C74MQDSFAXO5SAZ2BG2QMHZZWSOX2BW3DACVRYW6F2QKDMQQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: storage node overloaded, request limit: 2000 Dec 8 17:02:48.845983839 (73h34m49.673692221s) [upload=76480]: Next returned nil segment Dec 8 17:02:48.845997556 (73h34m49.673705948s) [upload=76480]: Waiting for error group managing segments... Dec 8 17:02:48.853006781 (73h34m49.680715171s) [noise=true , address=145.79.227.6:4257 , piece_id=IKR5EZUXWCEVA5SQ7546KXSKWTBDYQJ7AMTVXX2T25IOOMW2TKCQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.853644007 (73h34m49.681352402s) [noise=true , address=145.79.227.12:4765 , piece_id=R6SQ4SBMCWD4DKP4FAGLPUMSOA4KRF4F2AML2TV464ZYIQ537JFA, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.856107946 (73h34m49.68381634s) [noise=true , address=145.79.227.22:4510 , piece_id=KVY33OABWKC4AHQXGQ2QQZBB6TNGSSSR4ZOZN56NHBGGBJUQEYLQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.856510829 (73h34m49.684219222s) [noise=true , address=145.79.227.26:4654 , piece_id=2FHPIZA5BL7Q4JQQZE56KLIUKCNUW7CUARG72SP4Q7YBLEV7VA7A, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.856772442 (73h34m49.684480837s) [noise=true , address=145.79.227.34:4907 , piece_id=YGIATRQPO6ZWFZD45CSFBSVL7L3DRNGIC5RJGPPOV6CSNXDNEDLQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.856975680 (73h34m49.684684071s) [noise=true , address=145.79.227.29:4941 , piece_id=P2Z5FPJDTTTKH3ZL4UU3JW6NC2VJ34RG4CIMAXRW6Z5EZPHUQQ6Q, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.857242047 (73h34m49.68495045s) [noise=true , address=145.79.227.24:4583 , piece_id=VWEGXRGYJXX7H75WUTBDZFZ3HPR74VPII4K6SJPBFV62FCXS5JIQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.857377588 (73h34m49.68508598s) [noise=true , address=145.79.227.28:4726 , piece_id=SBWY4VB3BN65MOVJO22NIR2HN7CS63ODABH4XH3O55NDHCCMCM2A, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.857752465 (73h34m49.68546086s) [noise=true , address=145.79.227.23:4547 , piece_id=FKELFFQLGRPRX5L7FKMDZPOTBDHMKQDP6HJQUYLUDVMXOSKIMXGA, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.857759093 (73h34m49.685467489s) [noise=true , address=145.79.227.23:4546 , piece_id=L2UX5LJADQOQVS7ZKHBOTHKZNXXV22W4UJ3OUGCSHWUDMHT4EYRA, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.858219382 (73h34m49.685927774s) [noise=true , address=145.79.227.27:4690 , piece_id=IWPD3QZEMPXRZVSDS7S6UEIHELJEVVWIECBE527FNIF25ZG2NP2Q, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.859176521 (73h34m49.686884917s) [noise=true , address=145.79.227.41:4086 , piece_id=QVKEINCWGAGSEBYCFWPHLGVDRLQLVT35LZCCCYF3VSKTWLY5EYRQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:03:18.698437167 (73h35m19.526145561s) [noise=true , address=77.90.31.13:4627 , piece_id=DCNTHYBRJN5Q2IWGPKRQ7LEKYCSXOQSLQ5GI4YGPNGVQINLQKIYQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: expected piece hash; context deadline exceeded; EOF Dec 8 17:03:18.698506535 (73h35m19.526214917s) [seg_pos={0 0}, upload=76480]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 8 17:03:18.724186991 (73h35m19.551895387s) [upload=76480]: Done uploading segments... Dec 8 17:03:18.724296376 (73h35m19.552004781s) [upload=76480]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 503.483444ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 443.188336ms trace: https://jaeger.dev.storj.io/trace/535d44beeeafe52a FAIL (2025-12-08 17:04:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 8 17:02:48.738023080 (73h34m49.565731479s) [upload=76480]: Starting upload Dec 8 17:02:48.738095838 (73h34m49.565804247s) [upload=76480]: Done starting upload Dec 8 17:02:48.738417931 (73h34m49.566126324s) [upload=76480]: Uploading segments... Dec 8 17:02:48.738470600 (73h34m49.566179003s) [upload=76480]: Got next segment. Inline: false Dec 8 17:02:48.738517579 (73h34m49.56622597s) [upload=76480]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 17:02:48.738523576 (73h34m49.566231968s) [upload=76480]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 17:02:48.769802661 (73h34m49.597511053s) [seg_pos={0 0}, upload=76480]: Begin upload segment... Dec 8 17:02:48.769865494 (73h34m49.597573886s) [seg_pos={0 0}, upload=76480]: Done begin upload segment. Dec 8 17:02:48.769907136 (73h34m49.597615538s) [noise=true , address=145.79.227.26:4654 , piece_id=2FHPIZA5BL7Q4JQQZE56KLIUKCNUW7CUARG72SP4Q7YBLEV7VA7A, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.769939359 (73h34m49.597647766s) [noise=true , address=77.90.31.13:4628 , piece_id=LTI5XLVJMTZ2U373UX2L4AMJEILTDR2PYFQBAF5DKEVNQSKD5CXA, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.770462858 (73h34m49.598171256s) [noise=true , address=145.79.227.12:4765 , piece_id=R6SQ4SBMCWD4DKP4FAGLPUMSOA4KRF4F2AML2TV464ZYIQ537JFA, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.770592023 (73h34m49.59830042s) [noise=true , address=145.79.227.34:4907 , piece_id=YGIATRQPO6ZWFZD45CSFBSVL7L3DRNGIC5RJGPPOV6CSNXDNEDLQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.770900372 (73h34m49.598608765s) [noise=true , address=145.79.227.23:4546 , piece_id=L2UX5LJADQOQVS7ZKHBOTHKZNXXV22W4UJ3OUGCSHWUDMHT4EYRA, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.770964143 (73h34m49.598672541s) [noise=true , address=77.90.31.21:4877 , piece_id=3B56C74MQDSFAXO5SAZ2BG2QMHZZWSOX2BW3DACVRYW6F2QKDMQQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.771340212 (73h34m49.599048606s) [noise=true , address=145.79.227.41:4086 , piece_id=QVKEINCWGAGSEBYCFWPHLGVDRLQLVT35LZCCCYF3VSKTWLY5EYRQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.771369877 (73h34m49.599078273s) [noise=true , address=145.79.227.27:4690 , piece_id=IWPD3QZEMPXRZVSDS7S6UEIHELJEVVWIECBE527FNIF25ZG2NP2Q, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.771701791 (73h34m49.599410175s) [noise=true , address=145.79.227.29:4941 , piece_id=P2Z5FPJDTTTKH3ZL4UU3JW6NC2VJ34RG4CIMAXRW6Z5EZPHUQQ6Q, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.771839972 (73h34m49.599548367s) [noise=true , address=145.79.227.22:4510 , piece_id=KVY33OABWKC4AHQXGQ2QQZBB6TNGSSSR4ZOZN56NHBGGBJUQEYLQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.772466849 (73h34m49.600175247s) [noise=true , address=77.90.31.13:4627 , piece_id=DCNTHYBRJN5Q2IWGPKRQ7LEKYCSXOQSLQ5GI4YGPNGVQINLQKIYQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.772890389 (73h34m49.600598785s) [noise=true , address=145.79.227.6:4257 , piece_id=IKR5EZUXWCEVA5SQ7546KXSKWTBDYQJ7AMTVXX2T25IOOMW2TKCQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.773397195 (73h34m49.601105589s) [noise=true , address=145.79.227.28:4726 , piece_id=SBWY4VB3BN65MOVJO22NIR2HN7CS63ODABH4XH3O55NDHCCMCM2A, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.773517775 (73h34m49.601226156s) [noise=true , address=77.90.31.12:4589 , piece_id=LJUT5EHGQZJYA2AS5S53CJULTOK4LQYV3ZDZUJAFXLIY3BPO3SFQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.773954120 (73h34m49.601662518s) [noise=true , address=145.79.227.24:4583 , piece_id=VWEGXRGYJXX7H75WUTBDZFZ3HPR74VPII4K6SJPBFV62FCXS5JIQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.774310139 (73h34m49.602018536s) [noise=true , address=145.79.227.23:4547 , piece_id=FKELFFQLGRPRX5L7FKMDZPOTBDHMKQDP6HJQUYLUDVMXOSKIMXGA, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.799192405 (73h34m49.626900805s) [noise=true , address=77.90.31.13:4628 , piece_id=LTI5XLVJMTZ2U373UX2L4AMJEILTDR2PYFQBAF5DKEVNQSKD5CXA, seg_pos={0 0}, upload=76480]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: storage node overloaded, request limit: 2000 Dec 8 17:02:48.799876711 (73h34m49.627585112s) [noise=true , address=77.90.31.12:4589 , piece_id=LJUT5EHGQZJYA2AS5S53CJULTOK4LQYV3ZDZUJAFXLIY3BPO3SFQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: storage node overloaded, request limit: 2000 Dec 8 17:02:48.807505994 (73h34m49.635214394s) [noise=true , address=77.90.31.21:4877 , piece_id=3B56C74MQDSFAXO5SAZ2BG2QMHZZWSOX2BW3DACVRYW6F2QKDMQQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: storage node overloaded, request limit: 2000 Dec 8 17:02:48.845983839 (73h34m49.673692221s) [upload=76480]: Next returned nil segment Dec 8 17:02:48.845997556 (73h34m49.673705948s) [upload=76480]: Waiting for error group managing segments... Dec 8 17:02:48.853006781 (73h34m49.680715171s) [noise=true , address=145.79.227.6:4257 , piece_id=IKR5EZUXWCEVA5SQ7546KXSKWTBDYQJ7AMTVXX2T25IOOMW2TKCQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.853644007 (73h34m49.681352402s) [noise=true , address=145.79.227.12:4765 , piece_id=R6SQ4SBMCWD4DKP4FAGLPUMSOA4KRF4F2AML2TV464ZYIQ537JFA, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.856107946 (73h34m49.68381634s) [noise=true , address=145.79.227.22:4510 , piece_id=KVY33OABWKC4AHQXGQ2QQZBB6TNGSSSR4ZOZN56NHBGGBJUQEYLQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.856510829 (73h34m49.684219222s) [noise=true , address=145.79.227.26:4654 , piece_id=2FHPIZA5BL7Q4JQQZE56KLIUKCNUW7CUARG72SP4Q7YBLEV7VA7A, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.856772442 (73h34m49.684480837s) [noise=true , address=145.79.227.34:4907 , piece_id=YGIATRQPO6ZWFZD45CSFBSVL7L3DRNGIC5RJGPPOV6CSNXDNEDLQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.856975680 (73h34m49.684684071s) [noise=true , address=145.79.227.29:4941 , piece_id=P2Z5FPJDTTTKH3ZL4UU3JW6NC2VJ34RG4CIMAXRW6Z5EZPHUQQ6Q, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.857242047 (73h34m49.68495045s) [noise=true , address=145.79.227.24:4583 , piece_id=VWEGXRGYJXX7H75WUTBDZFZ3HPR74VPII4K6SJPBFV62FCXS5JIQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.857377588 (73h34m49.68508598s) [noise=true , address=145.79.227.28:4726 , piece_id=SBWY4VB3BN65MOVJO22NIR2HN7CS63ODABH4XH3O55NDHCCMCM2A, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.857752465 (73h34m49.68546086s) [noise=true , address=145.79.227.23:4547 , piece_id=FKELFFQLGRPRX5L7FKMDZPOTBDHMKQDP6HJQUYLUDVMXOSKIMXGA, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.857759093 (73h34m49.685467489s) [noise=true , address=145.79.227.23:4546 , piece_id=L2UX5LJADQOQVS7ZKHBOTHKZNXXV22W4UJ3OUGCSHWUDMHT4EYRA, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.858219382 (73h34m49.685927774s) [noise=true , address=145.79.227.27:4690 , piece_id=IWPD3QZEMPXRZVSDS7S6UEIHELJEVVWIECBE527FNIF25ZG2NP2Q, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.859176521 (73h34m49.686884917s) [noise=true , address=145.79.227.41:4086 , piece_id=QVKEINCWGAGSEBYCFWPHLGVDRLQLVT35LZCCCYF3VSKTWLY5EYRQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:03:18.698437167 (73h35m19.526145561s) [noise=true , address=77.90.31.13:4627 , piece_id=DCNTHYBRJN5Q2IWGPKRQ7LEKYCSXOQSLQ5GI4YGPNGVQINLQKIYQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: expected piece hash; context deadline exceeded; EOF Dec 8 17:03:18.698506535 (73h35m19.526214917s) [seg_pos={0 0}, upload=76480]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 8 17:03:18.724186991 (73h35m19.551895387s) [upload=76480]: Done uploading segments... Dec 8 17:03:18.724296376 (73h35m19.552004781s) [upload=76480]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 443.23616ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 499.79033ms trace: https://jaeger.dev.storj.io/trace/535d44beeeafe52a FAIL (2025-12-08 17:04:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 8 17:02:48.738023080 (73h34m49.565731479s) [upload=76480]: Starting upload Dec 8 17:02:48.738095838 (73h34m49.565804247s) [upload=76480]: Done starting upload Dec 8 17:02:48.738417931 (73h34m49.566126324s) [upload=76480]: Uploading segments... Dec 8 17:02:48.738470600 (73h34m49.566179003s) [upload=76480]: Got next segment. Inline: false Dec 8 17:02:48.738517579 (73h34m49.56622597s) [upload=76480]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 17:02:48.738523576 (73h34m49.566231968s) [upload=76480]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 17:02:48.769802661 (73h34m49.597511053s) [seg_pos={0 0}, upload=76480]: Begin upload segment... Dec 8 17:02:48.769865494 (73h34m49.597573886s) [seg_pos={0 0}, upload=76480]: Done begin upload segment. Dec 8 17:02:48.769907136 (73h34m49.597615538s) [noise=true , address=145.79.227.26:4654 , piece_id=2FHPIZA5BL7Q4JQQZE56KLIUKCNUW7CUARG72SP4Q7YBLEV7VA7A, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.769939359 (73h34m49.597647766s) [noise=true , address=77.90.31.13:4628 , piece_id=LTI5XLVJMTZ2U373UX2L4AMJEILTDR2PYFQBAF5DKEVNQSKD5CXA, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.770462858 (73h34m49.598171256s) [noise=true , address=145.79.227.12:4765 , piece_id=R6SQ4SBMCWD4DKP4FAGLPUMSOA4KRF4F2AML2TV464ZYIQ537JFA, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.770592023 (73h34m49.59830042s) [noise=true , address=145.79.227.34:4907 , piece_id=YGIATRQPO6ZWFZD45CSFBSVL7L3DRNGIC5RJGPPOV6CSNXDNEDLQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.770900372 (73h34m49.598608765s) [noise=true , address=145.79.227.23:4546 , piece_id=L2UX5LJADQOQVS7ZKHBOTHKZNXXV22W4UJ3OUGCSHWUDMHT4EYRA, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.770964143 (73h34m49.598672541s) [noise=true , address=77.90.31.21:4877 , piece_id=3B56C74MQDSFAXO5SAZ2BG2QMHZZWSOX2BW3DACVRYW6F2QKDMQQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.771340212 (73h34m49.599048606s) [noise=true , address=145.79.227.41:4086 , piece_id=QVKEINCWGAGSEBYCFWPHLGVDRLQLVT35LZCCCYF3VSKTWLY5EYRQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.771369877 (73h34m49.599078273s) [noise=true , address=145.79.227.27:4690 , piece_id=IWPD3QZEMPXRZVSDS7S6UEIHELJEVVWIECBE527FNIF25ZG2NP2Q, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.771701791 (73h34m49.599410175s) [noise=true , address=145.79.227.29:4941 , piece_id=P2Z5FPJDTTTKH3ZL4UU3JW6NC2VJ34RG4CIMAXRW6Z5EZPHUQQ6Q, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.771839972 (73h34m49.599548367s) [noise=true , address=145.79.227.22:4510 , piece_id=KVY33OABWKC4AHQXGQ2QQZBB6TNGSSSR4ZOZN56NHBGGBJUQEYLQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.772466849 (73h34m49.600175247s) [noise=true , address=77.90.31.13:4627 , piece_id=DCNTHYBRJN5Q2IWGPKRQ7LEKYCSXOQSLQ5GI4YGPNGVQINLQKIYQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.772890389 (73h34m49.600598785s) [noise=true , address=145.79.227.6:4257 , piece_id=IKR5EZUXWCEVA5SQ7546KXSKWTBDYQJ7AMTVXX2T25IOOMW2TKCQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.773397195 (73h34m49.601105589s) [noise=true , address=145.79.227.28:4726 , piece_id=SBWY4VB3BN65MOVJO22NIR2HN7CS63ODABH4XH3O55NDHCCMCM2A, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.773517775 (73h34m49.601226156s) [noise=true , address=77.90.31.12:4589 , piece_id=LJUT5EHGQZJYA2AS5S53CJULTOK4LQYV3ZDZUJAFXLIY3BPO3SFQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.773954120 (73h34m49.601662518s) [noise=true , address=145.79.227.24:4583 , piece_id=VWEGXRGYJXX7H75WUTBDZFZ3HPR74VPII4K6SJPBFV62FCXS5JIQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.774310139 (73h34m49.602018536s) [noise=true , address=145.79.227.23:4547 , piece_id=FKELFFQLGRPRX5L7FKMDZPOTBDHMKQDP6HJQUYLUDVMXOSKIMXGA, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.799192405 (73h34m49.626900805s) [noise=true , address=77.90.31.13:4628 , piece_id=LTI5XLVJMTZ2U373UX2L4AMJEILTDR2PYFQBAF5DKEVNQSKD5CXA, seg_pos={0 0}, upload=76480]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: storage node overloaded, request limit: 2000 Dec 8 17:02:48.799876711 (73h34m49.627585112s) [noise=true , address=77.90.31.12:4589 , piece_id=LJUT5EHGQZJYA2AS5S53CJULTOK4LQYV3ZDZUJAFXLIY3BPO3SFQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: storage node overloaded, request limit: 2000 Dec 8 17:02:48.807505994 (73h34m49.635214394s) [noise=true , address=77.90.31.21:4877 , piece_id=3B56C74MQDSFAXO5SAZ2BG2QMHZZWSOX2BW3DACVRYW6F2QKDMQQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: storage node overloaded, request limit: 2000 Dec 8 17:02:48.845983839 (73h34m49.673692221s) [upload=76480]: Next returned nil segment Dec 8 17:02:48.845997556 (73h34m49.673705948s) [upload=76480]: Waiting for error group managing segments... Dec 8 17:02:48.853006781 (73h34m49.680715171s) [noise=true , address=145.79.227.6:4257 , piece_id=IKR5EZUXWCEVA5SQ7546KXSKWTBDYQJ7AMTVXX2T25IOOMW2TKCQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.853644007 (73h34m49.681352402s) [noise=true , address=145.79.227.12:4765 , piece_id=R6SQ4SBMCWD4DKP4FAGLPUMSOA4KRF4F2AML2TV464ZYIQ537JFA, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.856107946 (73h34m49.68381634s) [noise=true , address=145.79.227.22:4510 , piece_id=KVY33OABWKC4AHQXGQ2QQZBB6TNGSSSR4ZOZN56NHBGGBJUQEYLQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.856510829 (73h34m49.684219222s) [noise=true , address=145.79.227.26:4654 , piece_id=2FHPIZA5BL7Q4JQQZE56KLIUKCNUW7CUARG72SP4Q7YBLEV7VA7A, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.856772442 (73h34m49.684480837s) [noise=true , address=145.79.227.34:4907 , piece_id=YGIATRQPO6ZWFZD45CSFBSVL7L3DRNGIC5RJGPPOV6CSNXDNEDLQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.856975680 (73h34m49.684684071s) [noise=true , address=145.79.227.29:4941 , piece_id=P2Z5FPJDTTTKH3ZL4UU3JW6NC2VJ34RG4CIMAXRW6Z5EZPHUQQ6Q, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.857242047 (73h34m49.68495045s) [noise=true , address=145.79.227.24:4583 , piece_id=VWEGXRGYJXX7H75WUTBDZFZ3HPR74VPII4K6SJPBFV62FCXS5JIQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.857377588 (73h34m49.68508598s) [noise=true , address=145.79.227.28:4726 , piece_id=SBWY4VB3BN65MOVJO22NIR2HN7CS63ODABH4XH3O55NDHCCMCM2A, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.857752465 (73h34m49.68546086s) [noise=true , address=145.79.227.23:4547 , piece_id=FKELFFQLGRPRX5L7FKMDZPOTBDHMKQDP6HJQUYLUDVMXOSKIMXGA, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.857759093 (73h34m49.685467489s) [noise=true , address=145.79.227.23:4546 , piece_id=L2UX5LJADQOQVS7ZKHBOTHKZNXXV22W4UJ3OUGCSHWUDMHT4EYRA, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.858219382 (73h34m49.685927774s) [noise=true , address=145.79.227.27:4690 , piece_id=IWPD3QZEMPXRZVSDS7S6UEIHELJEVVWIECBE527FNIF25ZG2NP2Q, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.859176521 (73h34m49.686884917s) [noise=true , address=145.79.227.41:4086 , piece_id=QVKEINCWGAGSEBYCFWPHLGVDRLQLVT35LZCCCYF3VSKTWLY5EYRQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:03:18.698437167 (73h35m19.526145561s) [noise=true , address=77.90.31.13:4627 , piece_id=DCNTHYBRJN5Q2IWGPKRQ7LEKYCSXOQSLQ5GI4YGPNGVQINLQKIYQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: expected piece hash; context deadline exceeded; EOF Dec 8 17:03:18.698506535 (73h35m19.526214917s) [seg_pos={0 0}, upload=76480]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 8 17:03:18.724186991 (73h35m19.551895387s) [upload=76480]: Done uploading segments... Dec 8 17:03:18.724296376 (73h35m19.552004781s) [upload=76480]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 499.828892ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 431.308048ms trace: https://jaeger.dev.storj.io/trace/535d44beeeafe52a FAIL (2025-12-08 17:03:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 8 17:02:48.738023080 (73h34m49.565731479s) [upload=76480]: Starting upload Dec 8 17:02:48.738095838 (73h34m49.565804247s) [upload=76480]: Done starting upload Dec 8 17:02:48.738417931 (73h34m49.566126324s) [upload=76480]: Uploading segments... Dec 8 17:02:48.738470600 (73h34m49.566179003s) [upload=76480]: Got next segment. Inline: false Dec 8 17:02:48.738517579 (73h34m49.56622597s) [upload=76480]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 17:02:48.738523576 (73h34m49.566231968s) [upload=76480]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 17:02:48.769802661 (73h34m49.597511053s) [seg_pos={0 0}, upload=76480]: Begin upload segment... Dec 8 17:02:48.769865494 (73h34m49.597573886s) [seg_pos={0 0}, upload=76480]: Done begin upload segment. Dec 8 17:02:48.769907136 (73h34m49.597615538s) [noise=true , address=145.79.227.26:4654 , piece_id=2FHPIZA5BL7Q4JQQZE56KLIUKCNUW7CUARG72SP4Q7YBLEV7VA7A, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.769939359 (73h34m49.597647766s) [noise=true , address=77.90.31.13:4628 , piece_id=LTI5XLVJMTZ2U373UX2L4AMJEILTDR2PYFQBAF5DKEVNQSKD5CXA, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.770462858 (73h34m49.598171256s) [noise=true , address=145.79.227.12:4765 , piece_id=R6SQ4SBMCWD4DKP4FAGLPUMSOA4KRF4F2AML2TV464ZYIQ537JFA, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.770592023 (73h34m49.59830042s) [noise=true , address=145.79.227.34:4907 , piece_id=YGIATRQPO6ZWFZD45CSFBSVL7L3DRNGIC5RJGPPOV6CSNXDNEDLQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.770900372 (73h34m49.598608765s) [noise=true , address=145.79.227.23:4546 , piece_id=L2UX5LJADQOQVS7ZKHBOTHKZNXXV22W4UJ3OUGCSHWUDMHT4EYRA, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.770964143 (73h34m49.598672541s) [noise=true , address=77.90.31.21:4877 , piece_id=3B56C74MQDSFAXO5SAZ2BG2QMHZZWSOX2BW3DACVRYW6F2QKDMQQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.771340212 (73h34m49.599048606s) [noise=true , address=145.79.227.41:4086 , piece_id=QVKEINCWGAGSEBYCFWPHLGVDRLQLVT35LZCCCYF3VSKTWLY5EYRQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.771369877 (73h34m49.599078273s) [noise=true , address=145.79.227.27:4690 , piece_id=IWPD3QZEMPXRZVSDS7S6UEIHELJEVVWIECBE527FNIF25ZG2NP2Q, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.771701791 (73h34m49.599410175s) [noise=true , address=145.79.227.29:4941 , piece_id=P2Z5FPJDTTTKH3ZL4UU3JW6NC2VJ34RG4CIMAXRW6Z5EZPHUQQ6Q, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.771839972 (73h34m49.599548367s) [noise=true , address=145.79.227.22:4510 , piece_id=KVY33OABWKC4AHQXGQ2QQZBB6TNGSSSR4ZOZN56NHBGGBJUQEYLQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.772466849 (73h34m49.600175247s) [noise=true , address=77.90.31.13:4627 , piece_id=DCNTHYBRJN5Q2IWGPKRQ7LEKYCSXOQSLQ5GI4YGPNGVQINLQKIYQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.772890389 (73h34m49.600598785s) [noise=true , address=145.79.227.6:4257 , piece_id=IKR5EZUXWCEVA5SQ7546KXSKWTBDYQJ7AMTVXX2T25IOOMW2TKCQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.773397195 (73h34m49.601105589s) [noise=true , address=145.79.227.28:4726 , piece_id=SBWY4VB3BN65MOVJO22NIR2HN7CS63ODABH4XH3O55NDHCCMCM2A, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.773517775 (73h34m49.601226156s) [noise=true , address=77.90.31.12:4589 , piece_id=LJUT5EHGQZJYA2AS5S53CJULTOK4LQYV3ZDZUJAFXLIY3BPO3SFQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.773954120 (73h34m49.601662518s) [noise=true , address=145.79.227.24:4583 , piece_id=VWEGXRGYJXX7H75WUTBDZFZ3HPR74VPII4K6SJPBFV62FCXS5JIQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.774310139 (73h34m49.602018536s) [noise=true , address=145.79.227.23:4547 , piece_id=FKELFFQLGRPRX5L7FKMDZPOTBDHMKQDP6HJQUYLUDVMXOSKIMXGA, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.799192405 (73h34m49.626900805s) [noise=true , address=77.90.31.13:4628 , piece_id=LTI5XLVJMTZ2U373UX2L4AMJEILTDR2PYFQBAF5DKEVNQSKD5CXA, seg_pos={0 0}, upload=76480]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: storage node overloaded, request limit: 2000 Dec 8 17:02:48.799876711 (73h34m49.627585112s) [noise=true , address=77.90.31.12:4589 , piece_id=LJUT5EHGQZJYA2AS5S53CJULTOK4LQYV3ZDZUJAFXLIY3BPO3SFQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: storage node overloaded, request limit: 2000 Dec 8 17:02:48.807505994 (73h34m49.635214394s) [noise=true , address=77.90.31.21:4877 , piece_id=3B56C74MQDSFAXO5SAZ2BG2QMHZZWSOX2BW3DACVRYW6F2QKDMQQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: storage node overloaded, request limit: 2000 Dec 8 17:02:48.845983839 (73h34m49.673692221s) [upload=76480]: Next returned nil segment Dec 8 17:02:48.845997556 (73h34m49.673705948s) [upload=76480]: Waiting for error group managing segments... Dec 8 17:02:48.853006781 (73h34m49.680715171s) [noise=true , address=145.79.227.6:4257 , piece_id=IKR5EZUXWCEVA5SQ7546KXSKWTBDYQJ7AMTVXX2T25IOOMW2TKCQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.853644007 (73h34m49.681352402s) [noise=true , address=145.79.227.12:4765 , piece_id=R6SQ4SBMCWD4DKP4FAGLPUMSOA4KRF4F2AML2TV464ZYIQ537JFA, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.856107946 (73h34m49.68381634s) [noise=true , address=145.79.227.22:4510 , piece_id=KVY33OABWKC4AHQXGQ2QQZBB6TNGSSSR4ZOZN56NHBGGBJUQEYLQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.856510829 (73h34m49.684219222s) [noise=true , address=145.79.227.26:4654 , piece_id=2FHPIZA5BL7Q4JQQZE56KLIUKCNUW7CUARG72SP4Q7YBLEV7VA7A, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.856772442 (73h34m49.684480837s) [noise=true , address=145.79.227.34:4907 , piece_id=YGIATRQPO6ZWFZD45CSFBSVL7L3DRNGIC5RJGPPOV6CSNXDNEDLQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.856975680 (73h34m49.684684071s) [noise=true , address=145.79.227.29:4941 , piece_id=P2Z5FPJDTTTKH3ZL4UU3JW6NC2VJ34RG4CIMAXRW6Z5EZPHUQQ6Q, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.857242047 (73h34m49.68495045s) [noise=true , address=145.79.227.24:4583 , piece_id=VWEGXRGYJXX7H75WUTBDZFZ3HPR74VPII4K6SJPBFV62FCXS5JIQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.857377588 (73h34m49.68508598s) [noise=true , address=145.79.227.28:4726 , piece_id=SBWY4VB3BN65MOVJO22NIR2HN7CS63ODABH4XH3O55NDHCCMCM2A, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.857752465 (73h34m49.68546086s) [noise=true , address=145.79.227.23:4547 , piece_id=FKELFFQLGRPRX5L7FKMDZPOTBDHMKQDP6HJQUYLUDVMXOSKIMXGA, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.857759093 (73h34m49.685467489s) [noise=true , address=145.79.227.23:4546 , piece_id=L2UX5LJADQOQVS7ZKHBOTHKZNXXV22W4UJ3OUGCSHWUDMHT4EYRA, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.858219382 (73h34m49.685927774s) [noise=true , address=145.79.227.27:4690 , piece_id=IWPD3QZEMPXRZVSDS7S6UEIHELJEVVWIECBE527FNIF25ZG2NP2Q, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.859176521 (73h34m49.686884917s) [noise=true , address=145.79.227.41:4086 , piece_id=QVKEINCWGAGSEBYCFWPHLGVDRLQLVT35LZCCCYF3VSKTWLY5EYRQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:03:18.698437167 (73h35m19.526145561s) [noise=true , address=77.90.31.13:4627 , piece_id=DCNTHYBRJN5Q2IWGPKRQ7LEKYCSXOQSLQ5GI4YGPNGVQINLQKIYQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: expected piece hash; context deadline exceeded; EOF Dec 8 17:03:18.698506535 (73h35m19.526214917s) [seg_pos={0 0}, upload=76480]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 8 17:03:18.724186991 (73h35m19.551895387s) [upload=76480]: Done uploading segments... Dec 8 17:03:18.724296376 (73h35m19.552004781s) [upload=76480]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 431.332926ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.029057402s trace: https://jaeger.dev.storj.io/trace/535d44beeeafe52a FAIL (2025-12-08 17:03:18 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 8 17:02:48.738023080 (73h34m49.565731479s) [upload=76480]: Starting upload Dec 8 17:02:48.738095838 (73h34m49.565804247s) [upload=76480]: Done starting upload Dec 8 17:02:48.738417931 (73h34m49.566126324s) [upload=76480]: Uploading segments... Dec 8 17:02:48.738470600 (73h34m49.566179003s) [upload=76480]: Got next segment. Inline: false Dec 8 17:02:48.738517579 (73h34m49.56622597s) [upload=76480]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 8 17:02:48.738523576 (73h34m49.566231968s) [upload=76480]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 8 17:02:48.769802661 (73h34m49.597511053s) [seg_pos={0 0}, upload=76480]: Begin upload segment... Dec 8 17:02:48.769865494 (73h34m49.597573886s) [seg_pos={0 0}, upload=76480]: Done begin upload segment. Dec 8 17:02:48.769907136 (73h34m49.597615538s) [noise=true , address=145.79.227.26:4654 , piece_id=2FHPIZA5BL7Q4JQQZE56KLIUKCNUW7CUARG72SP4Q7YBLEV7VA7A, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.769939359 (73h34m49.597647766s) [noise=true , address=77.90.31.13:4628 , piece_id=LTI5XLVJMTZ2U373UX2L4AMJEILTDR2PYFQBAF5DKEVNQSKD5CXA, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.770462858 (73h34m49.598171256s) [noise=true , address=145.79.227.12:4765 , piece_id=R6SQ4SBMCWD4DKP4FAGLPUMSOA4KRF4F2AML2TV464ZYIQ537JFA, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.770592023 (73h34m49.59830042s) [noise=true , address=145.79.227.34:4907 , piece_id=YGIATRQPO6ZWFZD45CSFBSVL7L3DRNGIC5RJGPPOV6CSNXDNEDLQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.770900372 (73h34m49.598608765s) [noise=true , address=145.79.227.23:4546 , piece_id=L2UX5LJADQOQVS7ZKHBOTHKZNXXV22W4UJ3OUGCSHWUDMHT4EYRA, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.770964143 (73h34m49.598672541s) [noise=true , address=77.90.31.21:4877 , piece_id=3B56C74MQDSFAXO5SAZ2BG2QMHZZWSOX2BW3DACVRYW6F2QKDMQQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.771340212 (73h34m49.599048606s) [noise=true , address=145.79.227.41:4086 , piece_id=QVKEINCWGAGSEBYCFWPHLGVDRLQLVT35LZCCCYF3VSKTWLY5EYRQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.771369877 (73h34m49.599078273s) [noise=true , address=145.79.227.27:4690 , piece_id=IWPD3QZEMPXRZVSDS7S6UEIHELJEVVWIECBE527FNIF25ZG2NP2Q, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.771701791 (73h34m49.599410175s) [noise=true , address=145.79.227.29:4941 , piece_id=P2Z5FPJDTTTKH3ZL4UU3JW6NC2VJ34RG4CIMAXRW6Z5EZPHUQQ6Q, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.771839972 (73h34m49.599548367s) [noise=true , address=145.79.227.22:4510 , piece_id=KVY33OABWKC4AHQXGQ2QQZBB6TNGSSSR4ZOZN56NHBGGBJUQEYLQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.772466849 (73h34m49.600175247s) [noise=true , address=77.90.31.13:4627 , piece_id=DCNTHYBRJN5Q2IWGPKRQ7LEKYCSXOQSLQ5GI4YGPNGVQINLQKIYQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.772890389 (73h34m49.600598785s) [noise=true , address=145.79.227.6:4257 , piece_id=IKR5EZUXWCEVA5SQ7546KXSKWTBDYQJ7AMTVXX2T25IOOMW2TKCQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.773397195 (73h34m49.601105589s) [noise=true , address=145.79.227.28:4726 , piece_id=SBWY4VB3BN65MOVJO22NIR2HN7CS63ODABH4XH3O55NDHCCMCM2A, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.773517775 (73h34m49.601226156s) [noise=true , address=77.90.31.12:4589 , piece_id=LJUT5EHGQZJYA2AS5S53CJULTOK4LQYV3ZDZUJAFXLIY3BPO3SFQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.773954120 (73h34m49.601662518s) [noise=true , address=145.79.227.24:4583 , piece_id=VWEGXRGYJXX7H75WUTBDZFZ3HPR74VPII4K6SJPBFV62FCXS5JIQ, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.774310139 (73h34m49.602018536s) [noise=true , address=145.79.227.23:4547 , piece_id=FKELFFQLGRPRX5L7FKMDZPOTBDHMKQDP6HJQUYLUDVMXOSKIMXGA, seg_pos={0 0}, upload=76480]: Uploading piece... Dec 8 17:02:48.799192405 (73h34m49.626900805s) [noise=true , address=77.90.31.13:4628 , piece_id=LTI5XLVJMTZ2U373UX2L4AMJEILTDR2PYFQBAF5DKEVNQSKD5CXA, seg_pos={0 0}, upload=76480]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: storage node overloaded, request limit: 2000 Dec 8 17:02:48.799876711 (73h34m49.627585112s) [noise=true , address=77.90.31.12:4589 , piece_id=LJUT5EHGQZJYA2AS5S53CJULTOK4LQYV3ZDZUJAFXLIY3BPO3SFQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: storage node overloaded, request limit: 2000 Dec 8 17:02:48.807505994 (73h34m49.635214394s) [noise=true , address=77.90.31.21:4877 , piece_id=3B56C74MQDSFAXO5SAZ2BG2QMHZZWSOX2BW3DACVRYW6F2QKDMQQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: storage node overloaded, request limit: 2000 Dec 8 17:02:48.845983839 (73h34m49.673692221s) [upload=76480]: Next returned nil segment Dec 8 17:02:48.845997556 (73h34m49.673705948s) [upload=76480]: Waiting for error group managing segments... Dec 8 17:02:48.853006781 (73h34m49.680715171s) [noise=true , address=145.79.227.6:4257 , piece_id=IKR5EZUXWCEVA5SQ7546KXSKWTBDYQJ7AMTVXX2T25IOOMW2TKCQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.853644007 (73h34m49.681352402s) [noise=true , address=145.79.227.12:4765 , piece_id=R6SQ4SBMCWD4DKP4FAGLPUMSOA4KRF4F2AML2TV464ZYIQ537JFA, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.856107946 (73h34m49.68381634s) [noise=true , address=145.79.227.22:4510 , piece_id=KVY33OABWKC4AHQXGQ2QQZBB6TNGSSSR4ZOZN56NHBGGBJUQEYLQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.856510829 (73h34m49.684219222s) [noise=true , address=145.79.227.26:4654 , piece_id=2FHPIZA5BL7Q4JQQZE56KLIUKCNUW7CUARG72SP4Q7YBLEV7VA7A, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.856772442 (73h34m49.684480837s) [noise=true , address=145.79.227.34:4907 , piece_id=YGIATRQPO6ZWFZD45CSFBSVL7L3DRNGIC5RJGPPOV6CSNXDNEDLQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.856975680 (73h34m49.684684071s) [noise=true , address=145.79.227.29:4941 , piece_id=P2Z5FPJDTTTKH3ZL4UU3JW6NC2VJ34RG4CIMAXRW6Z5EZPHUQQ6Q, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.857242047 (73h34m49.68495045s) [noise=true , address=145.79.227.24:4583 , piece_id=VWEGXRGYJXX7H75WUTBDZFZ3HPR74VPII4K6SJPBFV62FCXS5JIQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.857377588 (73h34m49.68508598s) [noise=true , address=145.79.227.28:4726 , piece_id=SBWY4VB3BN65MOVJO22NIR2HN7CS63ODABH4XH3O55NDHCCMCM2A, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.857752465 (73h34m49.68546086s) [noise=true , address=145.79.227.23:4547 , piece_id=FKELFFQLGRPRX5L7FKMDZPOTBDHMKQDP6HJQUYLUDVMXOSKIMXGA, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.857759093 (73h34m49.685467489s) [noise=true , address=145.79.227.23:4546 , piece_id=L2UX5LJADQOQVS7ZKHBOTHKZNXXV22W4UJ3OUGCSHWUDMHT4EYRA, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.858219382 (73h34m49.685927774s) [noise=true , address=145.79.227.27:4690 , piece_id=IWPD3QZEMPXRZVSDS7S6UEIHELJEVVWIECBE527FNIF25ZG2NP2Q, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:02:48.859176521 (73h34m49.686884917s) [noise=true , address=145.79.227.41:4086 , piece_id=QVKEINCWGAGSEBYCFWPHLGVDRLQLVT35LZCCCYF3VSKTWLY5EYRQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: <nil> Dec 8 17:03:18.698437167 (73h35m19.526145561s) [noise=true , address=77.90.31.13:4627 , piece_id=DCNTHYBRJN5Q2IWGPKRQ7LEKYCSXOQSLQ5GI4YGPNGVQINLQKIYQ, seg_pos={0 0}, upload=76480]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: expected piece hash; context deadline exceeded; EOF Dec 8 17:03:18.698506535 (73h35m19.526214917s) [seg_pos={0 0}, upload=76480]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 8 17:03:18.724186991 (73h35m19.551895387s) [upload=76480]: Done uploading segments... Dec 8 17:03:18.724296376 (73h35m19.552004781s) [upload=76480]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.029089667s core uplink us-select-1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 4.396563793s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:30:17 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.396594325s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 14.254436125s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:29:20 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 14.254469439s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 7.848346299s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:28:38 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 7.848376985s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.005634513s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:27:47 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.005661974s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 4.399188791s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:27:28 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.399215553s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 4.31365405s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:26:24 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.313681447s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 4.334064627s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:25:29 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.334100867s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 11.174863324s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:25:21 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 11.174909452s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 4.530264901s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:24:59 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.53028788s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 4.230493113s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:24:10 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.230527524s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 4.44076648s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:23:08 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.440792866s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 4.33406022s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:22:06 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.334158807s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 4.356962507s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:21:49 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.356995578s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 4.256397209s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:21:16 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.25662138s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 4.435757731s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:20:53 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.435789912s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 4.255494696s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:20:31 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.255520172s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 10.879946896s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:19:59 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 10.879972238s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 4.14960262s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:19:01 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.149628749s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 4.150755487s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:18:00 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.150785043s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 4.248092929s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:17:02 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.248196779s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 4.289581164s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:16:07 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.28961669s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 4.315576429s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:15:18 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.315597027s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 4.567438071s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:14:35 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.567465456s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 4.258770277s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:13:59 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.258798294s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 4.374777267s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:13:12 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.374811155s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 4.381984452s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:12:44 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.382014572s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 4.285485318s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:12:22 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.285515792s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 4.418933601s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:11:31 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.418962133s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 4.580436217s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:10:26 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.580462575s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 4.296565617s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:09:27 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.29659568s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 4.27383444s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:08:41 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.27386694s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [X..............................X............................] duration: 4.311351347s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:07:56 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.311456797s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.X..............................X...........................] duration: 4.290641701s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:07:38 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.290747757s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..X..............................X..........................] duration: 4.21626127s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:07:07 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.21628807s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...X..............................X.........................] duration: 5.896008028s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:06:33 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 5.896033341s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [....X..............................X........................] duration: 7.195404459s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:05:59 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 7.195429675s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....X..............................X.......................] duration: 8.483720769s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:05:25 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 8.483748578s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [......X..............................X......................] duration: 4.440962528s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:04:37 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.440995383s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......X..............................X.....................] duration: 4.296916815s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:03:23 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.296942367s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [........X..............................X....................] duration: 4.971302903s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:02:14 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.971331704s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........X..............................X...................] duration: 4.762602129s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:00:59 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.762692897s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........X..............................X..................] duration: 4.486629428s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:00:40 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.486659881s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........X..............................X.................] duration: 4.986797668s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 15:00:05 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 4.986829443s core uplink ap1
checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline) antiblip: 2 out of 60 is failed (threshold=3) [............X..............................X................] duration: 6.662616221s trace: https://jaeger.dev.storj.io/trace/4733455117a6aaf4 FAIL (2025-12-08 14:59:31 UTC) orbiter warning: operation: DownloadObject uplink: metaclient: context deadline exceeded Duration: 6.662643153s core uplink ap1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)

checkers.Uplink{Satellite: "121RTSDpyNZVcEU84Ticf2L1ntiuUimbWgfATz21tuvgk3vzoA6@ap1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.ap1.inline)