Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 778.407073ms FAIL (2025-06-20 04:42:29 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 778.437549ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 489.600393ms FAIL (2025-06-20 04:41:57 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 489.693403ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 496.419169ms FAIL (2025-06-20 04:41:42 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 496.450336ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 497.050965ms FAIL (2025-06-20 04:41:26 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 497.095525ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 540.950273ms FAIL (2025-06-20 04:40:29 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 540.998793ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 438.304113ms FAIL (2025-06-20 04:39:53 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 438.335131ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 482.096055ms FAIL (2025-06-20 04:39:20 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 482.126436ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 586.643159ms FAIL (2025-06-20 04:39:02 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 586.698895ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 560.523057ms FAIL (2025-06-20 04:37:53 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 560.54951ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 546.556678ms FAIL (2025-06-20 04:36:40 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 546.653517ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 461.572314ms FAIL (2025-06-20 04:35:36 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 461.609202ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 432.611513ms FAIL (2025-06-20 04:35:18 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 432.649253ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 481.901765ms FAIL (2025-06-20 04:34:46 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 481.929134ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 503.835454ms FAIL (2025-06-20 04:34:09 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 503.868354ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 426.614157ms FAIL (2025-06-20 04:32:56 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 426.649031ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 475.034223ms FAIL (2025-06-20 04:31:58 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 475.064188ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 505.921443ms FAIL (2025-06-20 04:31:22 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 505.953883ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 460.76052ms FAIL (2025-06-20 04:30:59 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 460.786743ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 523.855481ms FAIL (2025-06-20 04:29:49 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 523.883127ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 466.697457ms FAIL (2025-06-20 04:28:37 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 466.724634ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 537.643946ms FAIL (2025-06-20 04:27:40 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 537.675928ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 528.682384ms FAIL (2025-06-20 04:26:40 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 528.710145ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 401.982173ms FAIL (2025-06-20 04:25:53 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 402.008927ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 452.834456ms FAIL (2025-06-20 04:25:07 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 452.864142ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 472.203562ms FAIL (2025-06-20 04:24:46 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 472.233572ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 549.716617ms FAIL (2025-06-20 04:24:19 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 549.748958ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 598.586213ms FAIL (2025-06-20 04:23:12 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 598.620582ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 484.992486ms FAIL (2025-06-20 04:22:09 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 485.021573ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 481.142029ms FAIL (2025-06-20 04:21:19 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 481.169419ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 679.114963ms FAIL (2025-06-20 04:20:11 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 679.147223ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 468.74198ms FAIL (2025-06-20 04:19:10 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 468.770538ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 477.169376ms FAIL (2025-06-20 04:17:59 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 477.201363ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 445.43993ms FAIL (2025-06-20 04:16:51 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 445.532154ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 468.735984ms FAIL (2025-06-20 04:15:56 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 468.779771ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 444.283934ms FAIL (2025-06-20 04:15:12 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 444.310168ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 459.281688ms FAIL (2025-06-20 04:14:18 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 459.402488ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 514.351837ms FAIL (2025-06-20 04:13:22 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 514.382305ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 458.423615ms FAIL (2025-06-20 04:13:02 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 458.46448ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 490.857702ms FAIL (2025-06-20 04:12:44 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 490.889626ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 408.318681ms FAIL (2025-06-20 04:11:48 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 408.346114ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 432.058344ms FAIL (2025-06-20 04:11:00 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 432.093314ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 462.095388ms FAIL (2025-06-20 04:10:27 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 462.137587ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 460.611598ms FAIL (2025-06-20 04:09:32 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 460.64706ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 449.963158ms FAIL (2025-06-20 04:09:13 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 450.011527ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 432.952711ms FAIL (2025-06-20 04:08:46 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 432.983891ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 475.613624ms FAIL (2025-06-20 04:07:42 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 475.656775ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 555.570251ms FAIL (2025-06-20 04:07:11 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 555.597432ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 456.784693ms FAIL (2025-06-20 04:06:21 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 456.841597ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 490.54878ms FAIL (2025-06-20 04:05:24 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 490.581636ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 445.759346ms FAIL (2025-06-20 04:04:39 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil> Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments... Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil> Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments... Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment... Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment. Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece... Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments... Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces. Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil> Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil> Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments... Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil> Duration: 445.791368ms core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)