Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 472.294237ms FAIL (2025-06-22 13:21:45 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil> Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments... Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment... Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment. Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments... Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces. Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments... Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil> Duration: 472.317729ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 420.743494ms FAIL (2025-06-22 13:20:51 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil> Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments... Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment... Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment. Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments... Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces. Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments... Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil> Duration: 420.767646ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 516.243767ms FAIL (2025-06-22 13:20:29 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil> Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments... Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment... Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment. Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments... Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces. Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments... Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil> Duration: 516.27366ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 474.44791ms FAIL (2025-06-22 13:19:33 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil> Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments... Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment... Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment. Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments... Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces. Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments... Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil> Duration: 474.499052ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 546.019772ms FAIL (2025-06-22 13:18:57 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil> Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments... Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment... Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment. Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments... Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces. Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments... Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil> Duration: 546.050707ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 433.861447ms FAIL (2025-06-22 13:18:10 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil> Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments... Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment... Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment. Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments... Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces. Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments... Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil> Duration: 433.913008ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 652.665362ms FAIL (2025-06-22 13:17:18 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil> Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments... Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment... Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment. Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments... Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces. Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments... Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil> Duration: 652.69ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 908.990836ms FAIL (2025-06-22 13:16:59 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil> Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments... Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment... Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment. Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments... Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces. Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments... Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil> Duration: 909.02067ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 428.647549ms FAIL (2025-06-22 13:16:07 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil> Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments... Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment... Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment. Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments... Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces. Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments... Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil> Duration: 428.675945ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 415.431721ms FAIL (2025-06-22 13:15:41 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil> Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments... Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment... Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment. Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments... Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces. Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments... Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil> Duration: 415.456966ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 573.737911ms FAIL (2025-06-22 13:15:25 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil> Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments... Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment... Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment. Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments... Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces. Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments... Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil> Duration: 573.771231ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 484.611051ms FAIL (2025-06-22 13:14:15 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil> Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments... Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment... Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment. Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments... Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces. Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments... Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil> Duration: 484.640716ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 466.323272ms FAIL (2025-06-22 13:13:21 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil> Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments... Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment... Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment. Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments... Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces. Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments... Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil> Duration: 466.351467ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 496.970995ms FAIL (2025-06-22 13:12:12 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil> Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments... Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment... Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment. Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments... Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces. Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments... Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil> Duration: 497.000334ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 472.056142ms FAIL (2025-06-22 13:11:03 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil> Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments... Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment... Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment. Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments... Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces. Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments... Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil> Duration: 472.084568ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 477.456353ms FAIL (2025-06-22 13:10:16 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil> Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments... Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment... Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment. Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments... Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces. Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments... Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil> Duration: 477.51102ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 502.30392ms FAIL (2025-06-22 13:09:50 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil> Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments... Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment... Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment. Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments... Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces. Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments... Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil> Duration: 502.335306ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 446.423201ms FAIL (2025-06-22 13:09:09 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil> Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments... Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment... Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment. Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments... Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces. Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments... Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil> Duration: 446.45393ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 504.810841ms FAIL (2025-06-22 13:08:00 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil> Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments... Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment... Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment. Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments... Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces. Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments... Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil> Duration: 504.859787ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 511.85178ms FAIL (2025-06-22 13:07:36 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil> Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments... Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment... Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment. Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments... Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces. Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments... Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil> Duration: 511.902494ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 420.75534ms FAIL (2025-06-22 13:06:40 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil> Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments... Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment... Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment. Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments... Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces. Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments... Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil> Duration: 420.785657ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 506.86447ms FAIL (2025-06-22 13:05:52 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil> Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments... Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment... Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment. Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments... Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces. Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments... Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil> Duration: 506.894041ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 447.384711ms FAIL (2025-06-22 13:04:56 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil> Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments... Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment... Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment. Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments... Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces. Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments... Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil> Duration: 447.40749ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 423.139238ms FAIL (2025-06-22 13:03:57 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil> Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments... Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment... Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment. Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments... Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces. Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments... Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil> Duration: 423.171359ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 473.860367ms FAIL (2025-06-22 13:03:09 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 01:03.919690284 (92h37m39.483013277s) [upload=74098]: Upload finished. err: <nil> Jun 22 13:01:30.857480175 (92h38m6.420803186s) [upload=74105]: Starting upload Jun 22 13:01:30.857591136 (92h38m6.420914141s) [upload=74105]: Done starting upload Jun 22 13:01:30.857730952 (92h38m6.421053956s) [upload=74105]: Uploading segments... Jun 22 13:01:30.858150912 (92h38m6.421473924s) [upload=74105]: Got next segment. Inline: false Jun 22 13:01:30.858227158 (92h38m6.421550162s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jun 22 13:01:30.858232864 (92h38m6.421555865s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jun 22 13:01:30.897499311 (92h38m6.460822326s) [seg_pos={0 0}, upload=74105]: Begin upload segment... Jun 22 13:01:30.897565562 (92h38m6.460888555s) [seg_pos={0 0}, upload=74105]: Done begin upload segment. Jun 22 13:01:30.897642828 (92h38m6.46096584s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898355808 (92h38m6.461678815s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.898982872 (92h38m6.462305881s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899182094 (92h38m6.462505105s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899623708 (92h38m6.462946764s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.899755702 (92h38m6.463078712s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900265883 (92h38m6.463588893s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.900293926 (92h38m6.463616932s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.901770268 (92h38m6.465093291s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.902540302 (92h38m6.465863314s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.904287463 (92h38m6.467610471s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905105263 (92h38m6.468428276s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.905790230 (92h38m6.46911324s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907011195 (92h38m6.470334207s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.907718527 (92h38m6.47104154s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909090869 (92h38m6.472413884s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.909957295 (92h38m6.473280308s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.912530877 (92h38m6.475853881s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Uploading piece... Jun 22 13:01:30.975014548 (92h38m6.538337546s) [upload=74105]: Next returned nil segment Jun 22 13:01:30.975055011 (92h38m6.538378015s) [upload=74105]: Waiting for error group managing segments... Jun 22 13:01:31.001306872 (92h38m6.5646299s) [noise=true , address=104.36.82.45:6908 , piece_id=IC74WXXEUMJXVCYEQTUZET7X4DGTKHAOSABKIB44AZNXKNZKR7CA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.002235643 (92h38m6.565558641s) [noise=true , address=45.91.116.7:5037 , piece_id=JLSRSIEOI65TVBC2MVSA5TYGVERKBGSFUHLCHKLTXZCVMGPLT3LA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.010329741 (92h38m6.573652747s) [noise=true , address=104.36.82.6:5896 , piece_id=FUSLU6ZEOU5GSDBVXNYC56J2CNUEJKZV544CXCTI2FPQTVFMUI2Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.012721665 (92h38m6.576044655s) [noise=true , address=45.91.116.6:5000 , piece_id=YBPEMNE55UX4AVVB46SA73OHJYZY2QXCF3WT6SX24WKDD6WBJBCA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.013334653 (92h38m6.576657643s) [noise=true , address=104.36.82.37:6667 , piece_id=WSKZSIEFZKJFT7EOLSGG5C5BLHYUDMSWFWLBZW33EBOYNQOBFHFQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.014972994 (92h38m6.578295987s) [noise=true , address=79.127.219.51:4184 , piece_id=TXF36AXVNUMEMBRHDURI6UXDUK6LQ4GVVTHLHUBQR4EZBSXZYINQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.016933094 (92h38m6.5802561s) [noise=true , address=104.36.82.54:4177 , piece_id=DRBLBZCFLS374HBHDSEYJNJKTSC74YBL2GNPFEIXN6Y5ZYG6IA6Q, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.020484176 (92h38m6.583807167s) [noise=true , address=79.127.219.47:4058 , piece_id=U22QQ3JWRION7UU4FTVRODWH544DSYHOEHMNI3WVLTTPOISHCNFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022153843 (92h38m6.585476842s) [noise=true , address=104.36.82.13:6219 , piece_id=5YAWZOS25VUI4ZXCA3PKYN6KKL5PV3DPCDZPL4PFI5GWUDIYKTFA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.022223094 (92h38m6.585546121s) [noise=true , address=104.36.82.52:4117 , piece_id=OFGUP7YM75WBNSCMUAINHGQQ3QM7OGOOASIQ7IYJ3CVWLA3OQ45A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.023371183 (92h38m6.586694176s) [noise=true , address=104.36.82.21:6480 , piece_id=KPUPVG7NK7EL6P4ZZ7557KM3KO7ZAN7Y5LOXCM634LLS522KQXJQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.027743084 (92h38m6.591066084s) [noise=true , address=104.36.82.53:4152 , piece_id=QLBHSUVWZGGJ3CM4MMJECXIGV2UR4YX2RXKBGLKUMGFNLERK5SHA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.035232581 (92h38m6.598555579s) [noise=true , address=104.36.82.55:4213 , piece_id=NAGXV5BITXI66KEHW3RVXWHYS5OT5PAGWJL46NIZVSQMTTW4VH7A, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046381802 (92h38m6.609704802s) [noise=true , address=104.36.82.42:6797 , piece_id=KSKREQJFYSPVKC62UL32HCZQBUYKGJBBAL54XYNZ5VO64OQG4VDQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: <nil> Jun 22 13:01:31.046411797 (92h38m6.609734788s) [seg_pos={0 0}, upload=74105]: Segment reached optimal threshold of 14 pieces. Jun 22 13:01:31.046535818 (92h38m6.609858819s) [noise=true , address=104.36.82.15:6262 , piece_id=IKBIGLJ5DJVIUPI3UAYOF2BC6N5ZBE4DJM4M5VYDB25J3LATAPVA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12nPw17QDTyrgDBBNKuunFWuDqPV5Rd2GpM7Loc6Ws9vAAZz22s): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046813959 (92h38m6.61013696s) [noise=true , address=104.36.82.12:6184 , piece_id=SC3BT2NJIUUIK4AYUPEDOCYY5F2LOXQIOSTN7IAK5SL7GCJB37GA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17JJjwwgSn7A6BS7n1a7fphX8oTEQpXmad25ifM2nDhWhPv4Ls): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.046939966 (92h38m6.610262969s) [noise=true , address=104.36.82.5:5854 , piece_id=NNJMJILEOUZUZB3U3PAZCZQ6WBDO2VLHC2ONRSZQYBWVMLM6DSSQ, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:19pxQXokdTJ9W6k5aZrzGZSoAn9p1NqpwbTWMSC6U7ncr8ipwy): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047000243 (92h38m6.610323243s) [noise=true , address=104.36.82.3:5771 , piece_id=JSSKJEMNCD3CWDCA4RF5HIBHBJWA2F6JBCXF5QA6SNRJSJ2JYGAA, seg_pos={0 0}, upload=74105]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1rcgrMxg2fRfvh7EA1eUehzD5rSH1krUd5W5eC8KTo7vjYWFLL): protocol: expected piece hash; context canceled; EOF Jun 22 13:01:31.047079765 (92h38m6.610402766s) [seg_pos={0 0}, upload=74105]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jun 22 13:01:31.047151144 (92h38m6.610474143s) [upload=74105]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jun 22 13:01:31.047155956 (92h38m6.610478956s) [upload=74105]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jun 22 13:01:31.100669472 (92h38m6.663992477s) [upload=74105]: Done uploading segments... Jun 22 13:01:31.100694579 (92h38m6.664017579s) [upload=74105]: Upload finished. err: <nil> Duration: 473.893296ms core uplink us-select-1 us1-placement-20
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 72.815302ms FAIL (2025-06-22 06:40:34 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 72.923013ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 68.603313ms FAIL (2025-06-22 06:39:46 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 68.631561ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 69.057734ms FAIL (2025-06-22 06:38:50 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 69.099003ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 65.457272ms FAIL (2025-06-22 06:37:59 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 65.48409ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 78.127805ms FAIL (2025-06-22 06:37:31 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 78.152354ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 76.325489ms FAIL (2025-06-22 06:36:59 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 76.349194ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 70.294257ms FAIL (2025-06-22 06:36:15 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 70.32298ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 121.856701ms FAIL (2025-06-22 06:35:38 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 121.898659ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 85.142598ms FAIL (2025-06-22 06:35:07 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 85.162053ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 66.374912ms FAIL (2025-06-22 06:34:17 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 66.419122ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 89.649283ms FAIL (2025-06-22 06:34:01 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 89.673419ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [X..........X................................................] duration: 74.011672ms FAIL (2025-06-22 06:33:44 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 74.050159ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [.X..........X...............................................] duration: 96.0753ms FAIL (2025-06-22 06:33:03 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 96.105218ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [..X..........X..............................................] duration: 72.172114ms FAIL (2025-06-22 06:31:57 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 72.19191ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [...X..........X.............................................] duration: 71.928283ms FAIL (2025-06-22 06:30:42 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 71.952506ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 302.438534ms FAIL (2025-06-22 06:30:40 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 302.464572ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 314.817517ms FAIL (2025-06-22 06:30:10 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 314.857932ms edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [....X..........X............................................] duration: 88.540541ms FAIL (2025-06-22 06:29:51 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 88.571748ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [.....X..........X...........................................] duration: 69.285513ms FAIL (2025-06-22 06:29:20 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 69.309973ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 422.602948ms FAIL (2025-06-22 06:29:03 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 422.632121ms edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [......X..........X..........................................] duration: 98.563876ms FAIL (2025-06-22 06:28:53 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 98.581058ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [.......X..........X.........................................] duration: 70.262079ms FAIL (2025-06-22 06:28:24 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 70.288265ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 297.945123ms FAIL (2025-06-22 06:27:50 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 298.027201ms edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [........X..........X........................................] duration: 112.227035ms FAIL (2025-06-22 06:27:38 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 112.25573ms edge authservice http us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 2 out of 60 is failed (threshold=3) [.........X..........X.......................................] duration: 79.43081ms FAIL (2025-06-22 06:27:13 UTC) orbiter warning: unexpected status code "500 Internal Server Error" "\n" Duration: 79.454995ms edge authservice http us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)