Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
401.982173ms
FAIL (2025-06-20 04:25:53 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 402.008927ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
452.834456ms
FAIL (2025-06-20 04:25:07 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 452.864142ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
472.203562ms
FAIL (2025-06-20 04:24:46 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 472.233572ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
549.716617ms
FAIL (2025-06-20 04:24:19 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 549.748958ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
598.586213ms
FAIL (2025-06-20 04:23:12 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 598.620582ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
484.992486ms
FAIL (2025-06-20 04:22:09 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 485.021573ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
481.142029ms
FAIL (2025-06-20 04:21:19 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 481.169419ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
679.114963ms
FAIL (2025-06-20 04:20:11 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 679.147223ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
468.74198ms
FAIL (2025-06-20 04:19:10 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 468.770538ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
477.169376ms
FAIL (2025-06-20 04:17:59 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 477.201363ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
445.43993ms
FAIL (2025-06-20 04:16:51 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 445.532154ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
468.735984ms
FAIL (2025-06-20 04:15:56 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 468.779771ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
444.283934ms
FAIL (2025-06-20 04:15:12 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 444.310168ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
459.281688ms
FAIL (2025-06-20 04:14:18 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 459.402488ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
514.351837ms
FAIL (2025-06-20 04:13:22 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 514.382305ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
458.423615ms
FAIL (2025-06-20 04:13:02 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 458.46448ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
490.857702ms
FAIL (2025-06-20 04:12:44 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 490.889626ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
408.318681ms
FAIL (2025-06-20 04:11:48 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 408.346114ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
432.058344ms
FAIL (2025-06-20 04:11:00 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 432.093314ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
462.095388ms
FAIL (2025-06-20 04:10:27 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 462.137587ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
460.611598ms
FAIL (2025-06-20 04:09:32 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 460.64706ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
449.963158ms
FAIL (2025-06-20 04:09:13 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 450.011527ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
432.952711ms
FAIL (2025-06-20 04:08:46 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 432.983891ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
475.613624ms
FAIL (2025-06-20 04:07:42 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 475.656775ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
555.570251ms
FAIL (2025-06-20 04:07:11 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 555.597432ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
456.784693ms
FAIL (2025-06-20 04:06:21 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 456.841597ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
490.54878ms
FAIL (2025-06-20 04:05:24 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 490.581636ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
445.759346ms
FAIL (2025-06-20 04:04:39 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 445.791368ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
539.14323ms
FAIL (2025-06-20 04:04:21 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 539.237422ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
484.376143ms
FAIL (2025-06-20 04:03:25 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 484.406884ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
447.808634ms
FAIL (2025-06-20 04:02:50 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 447.838738ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
444.895181ms
FAIL (2025-06-20 04:02:28 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 444.922522ms
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001070129s
FAIL (2025-06-20 04:02:26 UTC)
orbiter warning:
======ERROR======
uplink: bucket: metaclient: context deadline exceeded
======LOGS======
oad=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658496785 (35h37m38.221819785s) [noise=true , address=104.36.82.9:6007 , piece_id=FH2WXRFUCT3WKSF4PZMEEYJN4GWWHNIRCWEYGCUKM5M5ZSHUQOWQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: <nil>
Jun 20 04:01:02.658588291 (35h37m38.221911279s) [noise=true , address=104.36.82.15:6258 , piece_id=4R4C6SFHYYMTJXJVSTF2XMFA4WZJWZYBY74GRN6SNAEM6EYLF3UQ, seg_pos={0 0}, upload=28516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:02.658610654 (35h37m38.221933654s) [seg_pos={0 0}, upload=28516]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil>
Jun 20 04:01:02.658709539 (35h37m38.222032546s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:02.658716258 (35h37m38.222039265s) [upload=28516]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:02.735434028 (35h37m38.298757036s) [upload=28516]: Done uploading segments...
Jun 20 04:01:02.735458571 (35h37m38.29878157s) [upload=28516]: Upload finished. err: <nil>
Jun 20 04:01:18.148025588 (35h37m53.711348577s) [upload=28520]: Starting upload
Jun 20 04:01:18.148084619 (35h37m53.711407618s) [upload=28520]: Done starting upload
Jun 20 04:01:18.148152898 (35h37m53.711475899s) [upload=28520]: Uploading segments...
Jun 20 04:01:18.148472676 (35h37m53.711795679s) [upload=28520]: Got next segment. Inline: false
Jun 20 04:01:18.148563862 (35h37m53.711886871s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jun 20 04:01:18.148571576 (35h37m53.711894583s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jun 20 04:01:18.181470188 (35h37m53.744793197s) [seg_pos={0 0}, upload=28520]: Begin upload segment...
Jun 20 04:01:18.181518196 (35h37m53.744841186s) [seg_pos={0 0}, upload=28520]: Done begin upload segment.
Jun 20 04:01:18.181545833 (35h37m53.744868835s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181551030 (35h37m53.744874032s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181926355 (35h37m53.74524936s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.181939345 (35h37m53.745262346s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182241365 (35h37m53.745564365s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182555037 (35h37m53.745878041s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.182810113 (35h37m53.746133114s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183114725 (35h37m53.746437728s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183375198 (35h37m53.746698183s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183650210 (35h37m53.746973212s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.183999520 (35h37m53.747322527s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184178634 (35h37m53.747501636s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.184455636 (35h37m53.747778639s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185228544 (35h37m53.748551531s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.185919618 (35h37m53.749242627s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.186891620 (35h37m53.750214608s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Uploading piece...
Jun 20 04:01:18.298548105 (35h37m53.86187109s) [upload=28520]: Next returned nil segment
Jun 20 04:01:18.298564810 (35h37m53.861887809s) [upload=28520]: Waiting for error group managing segments...
Jun 20 04:01:18.302352877 (35h37m53.865675869s) [noise=true , address=45.91.116.14:5190 , piece_id=GVL3Q4OUYG3RK5TEPZ3MCO4CEJQSXEKQLNKESBAC2VXNSAZGP4NQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.302986069 (35h37m53.866309083s) [noise=true , address=45.91.116.10:5083 , piece_id=OJSAR5S2DLY2ES6RUXG7L47EEZVJROJER3GON2PAYNK22VMKU3DA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.303695228 (35h37m53.867018229s) [noise=true , address=45.91.116.13:5155 , piece_id=APO33CPBWM43D36E7AOVLPRJRL3LAT3V6GNRHU3WU4KFYYAWIX2Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304363606 (35h37m53.867686613s) [noise=true , address=45.91.116.4:4940 , piece_id=4DUGBOF4OH7VVI2T6L6L4TOM2SW2KVEMARJ4F4QMXDOCWT6MP7UA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.304976059 (35h37m53.868299058s) [noise=true , address=77.90.31.18:4805 , piece_id=QEROAUGYM3GBWGABEWFUA2OJEU4QFSATP4FRJOTOOCZF4F2D5JCA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.305488021 (35h37m53.868811009s) [noise=true , address=45.91.116.8:5048 , piece_id=I2O4UU3C4J7ZWYH4DYDUQKWUONEV3RC3Q7X2CQA2BQQKCXBXGHZQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306148950 (35h37m53.86947195s) [noise=true , address=104.36.82.9:6005 , piece_id=XCD4ANJWOOZV35JCLL7KUOV5WZG3TB3TGPQLXILH7KR2VYD6SHLA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.306669337 (35h37m53.869992339s) [noise=true , address=104.36.82.7:5910 , piece_id=7HCR522ELGM5BAUBHDN5S37QA55Q2SRXJE7NIYRTA6VVRYGILMMQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307240193 (35h37m53.870563193s) [noise=true , address=104.36.82.2:5729 , piece_id=MJVCFJ2O3ZKLA6T5QORRX5WKHO577FUHLY7KKDJUBDHYD6SGCBVQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.307770903 (35h37m53.871093891s) [noise=true , address=104.36.82.2:5731 , piece_id=2DTHWVK2YX5QQBF7XNECA2IK7RSOFELYSWOAR6KWQ4EKDZHYHXFQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.308539367 (35h37m53.871862372s) [noise=true , address=45.91.116.12:5227 , piece_id=MR2JHBZ3K5NLGGUDB6Q4UJJ24MNQW5J3TOWDHOWYPXP322FK3RXQ, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309072889 (35h37m53.872395878s) [noise=true , address=77.90.31.12:4592 , piece_id=4MC753YGJBBXYF2FGMKC25OQ35BHAGWKLFLXHVD255GBUPBRFN4Q, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309585025 (35h37m53.872908013s) [noise=true , address=104.36.82.7:5909 , piece_id=DUZYHTGWMVWBVQPM4BA3KXHOX6IGAOBHKPEBQCFREQ4NTRRR5HNA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.309594525 (35h37m53.872917512s) [seg_pos={0 0}, upload=28520]: Segment reached optimal threshold of 13 pieces.
Jun 20 04:01:18.309702274 (35h37m53.873025263s) [noise=true , address=77.90.31.10:4518 , piece_id=2VRBLF4SDDC57W4RFX2UWHM6MCT4V4TG3WHH6NZEK2C3OAFMGQQA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3): protocol: expected piece hash; context canceled; EOF
Jun 20 04:01:18.310139253 (35h37m53.873462243s) [noise=true , address=104.36.82.8:5970 , piece_id=MWKYXMGIU56OLOUHNOZCESWNQ3NQ7FWNN5EWF5USD7DTFWSJ2CVA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310858945 (35h37m53.874181929s) [noise=true , address=77.90.31.18:4807 , piece_id=B2PPHCMVCVPJRR7TBJS4J44TJFSIAMDIJEX4DSELIR3CQYOVS3EA, seg_pos={0 0}, upload=28520]: Done uploading piece. err: <nil>
Jun 20 04:01:18.310889806 (35h37m53.874212806s) [seg_pos={0 0}, upload=28520]: Done waiting for segment. successful: 15 optimal: 13 errs: <nil>
Jun 20 04:01:18.310965104 (35h37m53.87428811s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jun 20 04:01:18.310969846 (35h37m53.874292849s) [upload=28520]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jun 20 04:01:18.372824031 (35h37m53.936147032s) [upload=28520]: Done uploading segments...
Jun 20 04:01:18.372845567 (35h37m53.936168566s) [upload=28520]: Upload finished. err: <nil>
Duration: 30.001093355s
core
uplink
us-select-1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
658.038249ms
FAIL (2025-06-19 23:40:45 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 658.066654ms
edge
authservice
http
bgp
eu1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
687.766872ms
FAIL (2025-06-19 23:39:51 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 687.789854ms
edge
authservice
http
bgp
eu1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
636.723672ms
FAIL (2025-06-19 23:38:53 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 636.770747ms
edge
authservice
http
bgp
eu1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
432.596833ms
FAIL (2025-06-19 23:37:45 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 432.619104ms
edge
authservice
http
bgp
eu1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
439.854808ms
FAIL (2025-06-19 23:37:14 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 439.878979ms
edge
authservice
http
bgp
eu1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
802.974669ms
FAIL (2025-06-19 23:36:58 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 803.000986ms
edge
authservice
http
bgp
eu1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
598.501831ms
FAIL (2025-06-19 23:36:08 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 598.541888ms
edge
authservice
http
bgp
eu1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
632.501271ms
FAIL (2025-06-19 23:35:32 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 632.530258ms
edge
authservice
http
bgp
eu1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
635.717862ms
FAIL (2025-06-19 23:34:50 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 635.761746ms
edge
authservice
http
bgp
eu1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
454.784475ms
FAIL (2025-06-19 23:33:42 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 454.8204ms
edge
authservice
http
bgp
eu1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
549.232546ms
FAIL (2025-06-19 23:33:07 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 549.25422ms
edge
authservice
http
bgp
eu1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
521.944083ms
FAIL (2025-06-19 23:32:10 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 521.973453ms
edge
authservice
http
bgp
eu1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
618.394355ms
FAIL (2025-06-19 23:31:45 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 618.418559ms
edge
authservice
http
bgp
eu1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
618.177267ms
FAIL (2025-06-19 23:30:33 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 618.256302ms
edge
authservice
http
bgp
eu1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
552.214368ms
FAIL (2025-06-19 23:30:15 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 552.244977ms
edge
authservice
http
bgp
eu1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
737.37317ms
FAIL (2025-06-19 23:29:21 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 737.402788ms
edge
authservice
http
bgp
eu1
|
checkers.AuthServiceHTTP{"https://auth.storjshare.io/", Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777"} failure (antiblip window 3/60): (authservice.eu1)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
492.051221ms
FAIL (2025-06-19 23:29:02 UTC)
orbiter warning: unexpected status code "500 Internal Server Error" "\n"
Duration: 492.080996ms
edge
authservice
http
bgp
eu1
|